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ABSTRACT 

This digast of 310 Project avaluation mathods is 
intandad to provida axamples of and guidelinas for avaluating 310 
projacts at the nationalv stata, and projact levals. The first 
section^ which is davoted to state-leval 310 avaluation projects^ 
includes a report on a longitudinal study assassing the impact of 310 
projects in Florida^ a raport reviawlng 10 yaars of 310 project 
activity in Pannsylvania, and a longitudinal study of adult basic 
aducation in Virginia. Tha second part of tha digast contains a 310 
self-assassmant administration guide and two examplas of raguests for 
proposals from tha Taxas 310 program* Tha guide includes various 
itamsralating to avaluation in the araas of priority satting, 
applications raviaw, 310 guidalines, project monitoring, and 
dissamination. Tha following materials are included in tha final 
saction^ which covers various projact evaluation strategies j a 
validation guide for adult education projacts devalopad for the New 
Jersaj Adult Education program, two papars ("Evaluation of 
Compatancy-Based Adult Education" and "Evaluating Innovative Adult 
Education Projactsi How to Maka Evaluation Work for ¥ou") that ware 
originally prasanted at tha siKth annual Compatancy Based Adult 
Educatibn Confarence, a siamnary of the National Adult Literacy 
Project's search for promising literacy practices^ sactions on staff 
davalopmant and program evaluation from a set of quality standards 
publishad by tha Division of Adult Education, and principles for 
planning and implamenting staff davalopmant that ara taken from a 
report davalopad by tha National Adult Basic Education Staff 
Devalopmant Consortium, (m) 



* Raproductlons suppliad by EDRS are tha best that can ba mada * 

* from tha original docunant. * 
******* 
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INTRODUCTIOM 



In 1975 the General AQcountlng Office (GAO) of the U.S. Congress 
isBuad a report recommending that the U.S* Department of Education 
"develop a procedure for identifying potential benefits for Section 
310 Projects^ eliminating duplication of effort and Insuring maximum 
dissemination and adoption of their results," h major reason that 
our success in meeting this challenge has been limited is the lack 
of attention given to evaluation of special projects and validation 
of project results. it simply Is difficult to recommend or facilitate 
the use of unproven practices and products on a national basis. 

This Digest of 310 Evaluation Methods is one step in urging States 
and projects to include an evaluation component in every major 
project funded under Section 310. The three sections Include 
examples of projects funded by States^ and instruments, methods 
and ideas developed through national and State programs and 
projects* 

If^ after reading this Digest, you have comments or questions 
concerning 310 evaluation^ please contacts 

James ' Parker 

Division of Adult Education 
U.S* Department of Education 
Washington , D.C. 20202-5 515 
(202) 732-2399 
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BThTE 310 IVALDATION PROJECTS 



All States are required to evaluate their 310 program at least every 
three years. This section includes information about recent evalua-- 
tion efforts in Florida^ Pennsylvania and Virginia, Each had its 
own distinct purposes and represents different approaches to 310 
evaluation. 

" The Impact of 310 Projects in Florida r 1980-1984 " determined the 
scope of impact of pro jects funded during that five year period. The 
evaluators surveyed a sample of local administrators and teachers / 
and conducted cas@ studies and project revie*&^Sa Included in this 
Digest ares The Executive Summary Methodology^ Strengths and 
Weaknesses^ and Recommendations for Improvement* 

Pennsylvania's three FOCUS Projects (Curriculum, Management , and 
iKcellenoe) were designed to identify, assess and publicize the 
results of 310 projects. Focus on Curriculum is covered here, 
including the bulletin on Mater ials for CI teracy Education, and 
sections of the Final Report describing methodology/ criteria, 
project evaluation and examples of ratings. 

The Virginia evaluation is a longitudinal study covering the years 
1970^1985, Both Section 306 and 310 programs were included in the 
three evaluations conducted over this 15 year period* The general 
design, procedures, findings and recommendations relating to 310 
projects are provided. 
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OP 310 PROJECTS m H,ORIDA 
1980-1984 



mroODOCTZOH 



&ince 1974r thm Buceau off Adult and CQmnuni^ EdueatiDn has 
Sundfd many projects under Seetion 310 of Publlo Law 91-23 0 as 
amended through Novraber 1, 1978» Theiie projaota ara raferrad 
to as 310 Frojeets and aoneiet of Speaial (Exparimantal) 
Damonstratlon and Teacher Training activities. 

Special (Experimental) Damonstration projects are focused on 
activities which are Innovative and have demonstrated potential 
for adding to, and/or, improving esistlng matari^s, methods 
and tachnlquesr and progrmis for adult education* Teacher 
Training projectSp on the other, hand, are s^cifically intandad 
for preparing adult educators to organise and atoinister 
programs or to dallvec instruction* 



FDRPOSB OW TBM STTOT 

The genarri purpose of the mtndy was to detarmina the scope and 
impact of 310 projects on adult education in Florida* 
Specifically, the stu^ provided information ons 

1, honr well 310 projects have helped^ to Improve 
instructional «id adnlnlstratlve skills of adult 
educmtorsf 

2. bow well 310 projects have helped to Increase the 
knowledge of adult educators in methodSp techniques 
and materials available for adult educatloni 

3, the degree to which 310 project esem^ary programs or 
models have helped to prraote more effective adult 
educational practices r 

4. hew well 310 proje^ products and processes have been 
effectively commtmlrated to the appropriate target 
popi^ationf 

5m the effectiveness of projects desl^ and 
impleaentatlon proceduresi 

Sm ^ssible areas o£ raptaasis in which adult educational 
af forts have not been effective i and 

7. Wim scope of 310 projects funded yearly* 
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It im hoped that the knowledge gained from the etu% will bm 
uaed for effective planning and deoiaion making which will help 
to improve the effaotiveness of 310 projeots* 



The sample ooneieted of 5 8 local adult education directors 
(administrators) and 304 teachers who have had the most 
participation in 310 project activities from 1980-1984, The 58 
local adult education directors represent Q3% of the total 
sample for this population and the 3 04 adult education teachers 
represent a random sample of 310 project participants in the 
counties, 

niree strategies were used to conduct the stu^i eiarv^ 
qneetloniiaire, case studies and p^oje^ rwlevs. The survey 
guestionnaire was constructed from the research objectives and 
administered to adult education administrators and teachers. 
Nineteen projects were selected for case studies based on the 
criteria of '•good examples" and "not so good examples" of 310 
projectSr typer sizer cost and geographical location* Projects 
from 1980-1984 were reviewed to determine their scope and how 
well national and state priorities for adult education were 
addressed^ 



FIRDZ^S 



The findings are presented according to the following research 
componentsi survey, case studies and project reviews. 



I* SURVEY RESOTiTS 

a^ Partlaipation in 310 ProjeAs 

Overall, adult education teaehers and adBinlstrators 
respond ver^ v^l to invitations to partlci^te in 310 
project aativities« 

From 1980-1984 the respondents received at least one invitation 
to attend a 310 project actlvl^* Within the same periods the 
average participation in 310 project activities (workshoprr 
conferences, inservlces, etc.) was five for the atoinistrators 
and three for the teachers. 



Banaf its off 310 Projeeta 



Partieipanta benefit from 310 projects through Teacher TrainJnq 
and Special (EKperiinental) Damonstration activities, 

Tai|ghag Tgalninq 

Thmtm wag an oir^rall indication that teacher training 
pro^ecta hav# h^ped adult educators in imprar^-ing their 
adelnl St ratine akills, knmrledge of materlala, methoda and 
techttiquea in adult education* 

About 90% of the teachers and adminiatratora who had attended 
310 project workahopSf Inaervices and conference presentations 
agreed that the activltiea were worthwhile* 



In general, the a^elfic contribution of teacher training 
projecta to individual Inaerrlce education programs was 
moderate to alnijial* 

This finding waa anticipated becauae of the limited number of 
teacher training projecta funded yearly (an average of aeven) 
in relation to the number of adult education programa in the 
State* However^ the contribution of teacher training projecta 
would be greatly increased if knowledge obtained by 
participants iapaased on through internal arrangements by 
individual programa, 



Special (ECTerlnental) Demonstration 

Kim effect of special CeKperimental) demonatration projects was 
aatermlned in three actlvi^ areasi exemplary programs^ 
e^iimplary curriculums and recruifanent and retention. 

bem^ary progress were rated ^ most of the participants 
as making good to excellent contribution to adult 
education practice. But, this contribution is mostly 
iJaited to lo^l pr^rams« 

Examples of exemplary programs include model projects designed 
to promote literal ^ improve life skillsr and develop basic 
academic skills including English for Speakers of Other 
Languages. Although these programs were found to be very 
effective in the environment in which they were implemented^ 
their statewide effect on other programs was limited. 

Exemplary currlculims were said to have made a moderate 
contribution to adult education programs. 

Exemplary curriculums were designed to provide learning 
structure in various subject matters. The statewide effect had 
been limited due to inadeguate dissemination efforts. 
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R^^rultiftanb^ and Ratenteion in various adult adueatlon 
progrms m^*rCTmrkably ^proved as ra]^ctad by 921 of the 
raspondentSs 

Thia rasult was of praatiaal significance especially for short 
terin programs and programs that continue after the termination 
of 310 project funds« However ^ long*"term retention dacreasad 
with time and the degraa of support provided by individual 
programs^ 



Psa of 310 Pro^act Bducational Batarlals 

Host of the respondents Indlratad that th^ read and used 
310 project natari^s as resourcas for adult education. 

Over a period of five yearsr the respondents read an average of 
thraa to six matarlals. 7his numbar is small in view o£ tha 69 
projects fundad in the same period. Since thara is evidance to 
indicate that 310 project materials have not been adequately 
dissemlnatedr there is potential to use the materials when 
available* 

In terms of future demand for adult education instructional 
matarialsr the majority of the participants suggastad 
instructional materials for taachera and studants such as 
curricular guides and current methods and techniques in adult 
education* 



d. DissCTlMtion 

Dissamlnatlon af forte have not baan adequate in making 
avallabla 310 projact produate to the Intandad target 
population. 

Dissemination is a raquir«ient for 310 project activities and 
involves two processes - Informing and sanding products to the 
concarnad target ^pulation* The stu^ indicated that both 
processes have not been adequately executed mai^ of the 
projects* 



e. Problms in Adult Iducatlon 

Nina problem areas were Idantiflad for 310 projects* The 
problms are listed according to the number of respondents 
iuggasting them* They ware recruitmant and retention (S7) f 
promotion and- dissemination (50) i outreach education (40) ; 
Adult Basic Education and inglish for Speakers of Other 
Languages (32) i teacher training activities (23) i eKceptional 

. 9 



ERIC 



aducatien (IS) t computer adueation (IS) $ curriGUlLun materials 
(10) I and cempatency^basad adult adueation (10). 



£• Suggaetiona for ^provCTiant 

Savaral euggaetions wara offarad ti^ tha raspondanta to halp 
improva tha activitlas of 310 projaata, Tha auggaations 
includas 

1) diaaaminating 310 prejeet raaults and productai 

2) producing a catalog of 310 projact matarialsi 

3) conduct ing a naad^ aaaaaamant to idantify problams of 
coimnon intaraati 

4) conducting a grant writing vrorkahop to halp Improva 
the quality of projects^ and 



A total of 19 projacta were aal acted for casa atudias in order 
tos 

1) datarmina heir wall tha projaet goals and ebj actives 
wa^a aahlevedf 

2) Identify strengths and waaknesses of tha projects^ and 

3} make reconmandatlons that oa^ help to Improve future 
projects. 

a* Proiact Goals and Objactivas 

Although th#re vara differences In the manner In which 
goals and bbjeot wara Implladp most of tha projacta 
achieved thtfir 'goals and objectlvas". 

There was a ganaral agraaroent among participants, thatr to a 
larga axtent^ their paraonal objactivaa for participating in 
tha projacta ware met, 

b. Strengths of tile Proj eeta 

The following were tha major strangtha of the projects* 

1. Recruitment and retantlon of studanta in individual 
programs. k > 



10.,. 



2. 



Matariala davelepad or purchaaad were being used as 
primal^ resoureaa* 



3* Continuity of aetivitias after tarmination of project 
funds - this was limited to a faw projects* 



c. Weaknasgas of the Proleets 

The roajor weaknesses of the projects are prasantad balow* 

Im Poor planning was the most conmon problwi« planning 
problams were in the form of lack of i^iranatry batwean 
goals^ objectivas^ plans of aotion and evaluation*. 

2. Follow-up activities were nagl acted by most of the 
projects^ This was attributed to lack of funds and 
time to conduct a follow-up during a grant pariod (12 
months) « 

3» Evidence of pro j act af f activenass was mostly limited 
to attitudinal change as measured by a post^test which 
was very general in half of the casas« 

4# Dissemination was limitedr In most casas, to 

description of project activities* However r some 
project had well prepared materials which ware 
dissaminatad to other progruas or sent to the office 
of tha Bureau of Adult and Conununity Education* 

5. Continui^ of project activities by the par ant 

Institution was not achieved ^ most of the concarnad 
projects* Lack of funds was the most common 
explanation given* 



d* Sogqestions to mpronra Future Proia^s 

Aa f olloiring suggestions mzm proposed to Improva tha 
effaotivanass of futiira projects^ 

h naads assasnant Is recomendad foe all 310 grants to 
astahllsh tha pcoblesip naaina constraints (himan and 
Batarial} r u&d Idantifiy TCtbods-*maans to Implaaant the 
proj aat« 
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2. Goal m and Ob j ecfclves 



Goals and ohjmatirmm should bm declvad fren neads 
mmmmmmkmnt results, mmrm should be a logloal transition 
f rosn goals or ^rposa to objeotiTes^ and from objoetiTas 
to aotl^ltlas* Tha objaotlv^as should ba spaalfla anough 
to ba iftaasuraabla, 

3 • Evaluation 

Ey^aluatlon should ba oonduotad to assess the aff eotlireness 
of the projaots. 

4m Polloy-up 

Follow-up plus should ba included to aaasura impact of 
tta proja^. 

5* PissOTlnation 



A pi w for dissaalnatlon should go beyond just nailing out 

Infoniatimi to all 1 oral dlrartbrsp to ineluda idantifjing 

tha primary audi enoe uid Informing tha audienoe about the 
nature of the products* 

0. Materials 

teteriids which are produced should not only be of good 
quality but ^mould be of ttm mppwop^tsitm reading level and 
graphic l^out to anabla users to benefit from the 
materials* These materials should ba usable ^ other 
adult aducation progrus* 

7* Docmnantation 

It is important that projert a^ivitles ba docmantad 
^stCTati^Uply. The record should include nmaas and 
addrassas of participants and other routine records of a 
projact* Care should be taken to dociment the strengthsr 
weaknesses^ problns encowitered, and to recommand how the 
process m^ be improved for future adaptation or adoption* 



HI* raOJBCT ^TIEirS 

Projact review activi^ consietad of an in-housa analysis of 
projects and Interview with the staff of the Bureau of Adult 
and Communis Education^ Bmphasls was on national and state 
priorities for 310 projaatsi scope of 310 projactsi and the 
adminlstrativa procass of 310 projeats* 
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a) national and state pgiorltias for 310 prejeets were 
eofflpar ad and found to be similiar. This impliad that the 
activi^ aentent of the projects were in agreement with national 
goals and state priorities for 310 projects, 

^^W^ of 310 pgQjert aoti^itlas were categorized into four 
types s speoxal demonstration^ teacher training* dual purpose 
and special projects* From 1080-1984 r 3 2 special 
demonstration^ 28 teacher training, 7 dual purpose and 2 
special purpose projects were funded* Thus there was a 
balanced distribution of special demonstration and teacher 
training projects* Dual pur ^se projects have elements of 
special demonstration and teacher training projects. Special 
purpose projects are Intended to facilitate the effectiveness 
of special demonstration and teacher training projects* 

Analysis of the projects for subject matter distribution showed 
that in the special demonstration categcryr adult basic 
education curriculum and materialSr literacy skills projects, 
and outreach progrms seemed to dominate the ^pe of projects 
funded most frequently* Student recruitanent and retention, 
computer-based instruction ^nd functional skills were low in 
frequent of funding* 

In the teacher training category, emphasis were on inservice 
education, and on materials, methods and techniques in adult 
education* 

0) Thm Ateinistra tl^e moammm of 310 projects was found to be 
adequate, except for the following recoTOiendatiom 

1) Quarterly and final report format or instruments should be 
modified to include more objective information* 

2) Grant award process will be further improved if previous 
project titles and abstracts are provided to the selection 
coiranlttee to avoid duplication of activities* In addition, 
persons appointed to the selection coinmittee should not 
have sutoitted a proposal for the fiscal year of their 
appointment* 



ormt^h coNc^osxoNS 

The overall result of the stu^ indicated that 310 projects 
have made a significant contribution to improve adult 
educational activities in Florida* Specifically, the greatest 
contribution was made in individual programs, recruitanent and 
retention, and staff developaent* Generally, a notable 
contribution was made in material developnent. 

As a competitive grant, 310 projects will continue to provide 
opportunities to individuals with inaightful ideas and progrMfts 
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with problems of eonmion concern to make contribution to the 
improvement of adult education statewide and nationally. 



The following recomnendations are presented in order of 
prior ii^ and are based on the result of the stufly, and the 
current state and national priorities for 310 projects^ 

Pi-yCTination of Results 
and Prov^en Practices 

In ^ieir of the aanp loaterl^e and eicraplary progrms or 
practioes vblch ha^e b#en developed and those Uat ace yet to 
hm developed^ a dissemination SYStra ehould be deslcped. The 
function of the dissemination ^stem should include* 

1) identification and review of all 310 project materials 
for the purpose of dissemination, 

2) identification and assessment of proven practices for 
diffusion and adoption/adaption of 310 projects by 
local adult education programs. 

3) establishment of information clearinghouse on adult 
education materials resources, modern educational 
technology and proven practices* This riearinghouse 
should be linked with other states and national data 
systems for the purpose of assisting educators seeking 
solution to educational problems. 

4) a^ulsition and evaluation of new materials, methods 
and technigues, and provision of information to local 
programs and institutions concerned with adult 
education. 



II. Staff Developaient 

Staff is elosaly linked to an effective dlssesination 
dev^opnent^ Itffectiva staff develofmant is necessary to 
update the skills, knovledge and attitudes of adult educational 
practitioners in material s, usage r contraporary developBent in 
educational technolo^ and proven practices* 

This function may be achieved through? 

1) a statewide staff training system to facilitate use of 
materials and adoption of proven practices* 
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2) a linkage ^stem in which ideas and experiances of 
different programs are exchanged via confer encaa and 
wor kshops« 

3) a consulting syatem which all progrMis may use as a 
resource for inservice education. 



III. Pro-jeot pro^sals 

Due to problois vltb the design of sone of the projects, thm 
f oilovlng recosffliendatlona are offered to improve grant writing 
ef £ ectl^enees t 



1) A grant writing activi^ be sponsored to conduct 
workshops for concerned adult educators. 
Alternatively^ a short-* term project may be conducted 
to produce a grant writing manual which should be made 
available to concerned adult education programs and 
other agencies or institutions* 

2) The current Section 310 Evaluation Guide be revised to 
incl udei 



a. at least a 3-step scale instead of "yes/no" scale 
of the current instrimenti 

b. items concerning needSr objectives^ plan of 
operation and evaluation should be expanded^ 

c^ abstracts of previous projects nay be given to 
persons requesting application forms i 

d. review committee should be appointed early and be 
provided with abstracts of previous projects; 

e. proposals which have very good ideas but were 
poorly written should be returned with suggestions 
and resubmittedi and 

f. when grants are aPPeoved,|roject director a should 
be eoStacted early to avoid further delay m 
project implenientation. 



T7. Monitorin g of pgoiecfcs 
1) problem of the study 



2) objeetives to resolve the problem^ 

3) aativities to achieve the objeetives based on 
timelines* and 

4) comments and suggestions^ 

The result of monitoring should be given to project directors 
to use as a guide in completing their projects* 



V* Final Ret»rts 

Final raports aheoldp In addition to narration of mcti^itieSr 
inelude strengths^ waakn#seaas and recramendations for adoption 
or adaption of tha project* Projects tbat are concerned with 
XDaterial production should ensure that the aatarials are 
suitable for the Intended audience* 



VI* Priorities 

It is recomended that a etatevide needs aasesaient be 
conduced to identi^ problns of mmon mncern, This 
recoaaendation should not binder individual insights but 
enhance the contribution of 310 projects to adult education 
programs. 




ERIC 



FRCSLEM STATEMENT 

The problem addressed in this stu^ was the lack of 
information and organized data concerning the scope and impact 
of 310 projects conducted in the State of Florida* Such 
information is necessary to determine how well national and 
state priorities for Adult Education are beiMg met and how 
affective the projects are in promoting adult edudational 
activities* 

Although project activities of Special Bzperlmental 

Damonstration and Teacher Training are mar^ and varied^ the 

Bureau of Adult and Community Education dees not have a 

consolidated document from which the following broad questions 

could be answered with certainty: 

1* What is the Impact of Special Experimental 

Demonstration and Teacher Training projects on Adult 
Education in Florida? 

2* What factors promote or prohibit the effectiveness of 
310 projects? 

3. To what extent are the projects funded meeting 

national and state priorities for adult education? 

4* Apart from the national and state priority 

specif icatlonSr is there a data base to guide the 
Bureau of Adult and Community Education and project 
selection eomnittee in determining priority areas 
which have not been properly addressed? 

5. What is the scope of 310 projects funded from year to 
year? 

Answers to the above questions are required for effective 
planning and decision making that will help to improve the 
effectiveness of 310 projects. 
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IQE^SB OF THE STODY 
The general purpose of the study was to determine the 
scope and impaot of 310 projects on adult education in Florida 
from 1980-1984* The specific objectives to be accomplished 
incl ude determining 2 

1* how well 310 projects have helped to improve instructional 
and adbQlnistrative skills of adult educator si 

2# how well 310 projects have helped to increase the knowledge 
of adult educators in methods, techniques and materials 
available for adult education^ 

3* the degree to which 310 projects' exemplary programs or 
models have helped to promote more effective adult 
educational practices^ 

4. how well 310 project products and processes have been 
effectively communicated to the appropriate target 
population; 

the effectiveness of projects design and implementation 
procedures; 

Sm possible areas of emphasis in which adult educational 
efforts have not been effective; and 

7. the scope of 310 projects funded yearly. 

The above objectives were used for designing data 

coll ection instruments. 



The sample for the stu^ consisted of aaninlstratorsr 
adult education teachers and students. Only participants who 
had actively participated in a 310 project were sampled* This 
minimum r^uirement was considered adequate, because of 
problems associated with high turnover of adult education 
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teachersr student frequant geographical mobility and 
inadequate doGumentation of participants. Throughout the 
study ^ the term, '^participant" was used to represent the sample 
of the stu^ . 

Sample Charaeteriatica 

There were three categoriee of participants. The first 
category consisted of adult education administrators who are 
responsible for administering adult educational activities in 
the counties. The administrators are called local education 
directors^ coordinators or supervisors^ and may be located in 
the county school board or in a communis college* 

The second category consisted of adult education teachers 
who are involved in instruction of adults* Adult education 
teachers may benefit from 310 projects by attending teacher 
training project activities to learn new methods and techniques 
(consumers) and/or by using 310 project materials for 
instruction* 

The third category consisted of adult education students 
who are the primary population targets of adult education* The 
students are direct or indirect consumers of 310 project 
activites. As direct consumersr the students use 310 projects 
materials or participate in demonstrational programs* As 
indirect consumer s, the students benefit from better 
instruction given by teachers who had attended 310 projects 
activities. 

Most of the sample for the stu^ consisted of teachers and 
administrators because they were more accessible* Adult 
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aducation students were difficult to reach as explained 
previously and because 310 projects activities do not exceed 
one year period. 



The sample was selected from participants who have 
participated in 310 project activities from 1980-1984, These 
years were chosen in view of the problems previously discussed, 

Admlnistratore 

A list of local adult education directors consisting of 83 
entries was obtained from the office of the Bureau of Adult and 
Community Education (BACE) . The list was reduced to 70 because 
some of the administrators had not participated In 310 
projects* Of the 70 atoinistrators^ 58 responded to the 
questionnaire. Their response constituted 83% of the total 
sample and was eonsldered adequate for the group* 

The population in this category was difficult to determine 
due to high job turnover , infr^uent participation in 310 
project activities^ inadequate and incomplete record of 
teachers who have participated in 310 project activities^ 
jyiother problem was that some of the counties with large adult 
education teachers have not had a 310 project between 
1980-'1984r but have sent a small number of teachers to attend a 
progrmm at a near^ county , community college or university, 
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Owing to the af oremantionad preblemsr a strict stratified 
random procedure could not be appliadp For e^ample^ 
participation in 310 project activities is not related to the 
number of teachers in each county i 310 projects are competitive 
and voluntary activities based on needs r rather than geographical 
or demographic characteristics. Thusr the sample of teachers 
was obtained by sending 10 questionnaires to each of the 
counties (67) * Each local director was instructed to distribute 
the questions to the teachers who had attended the moat 310 
pr o j ect s act iv i ti es* 

Although the total sample was 570 (67 k 10) r after 
adjusting for the counties which returned all questions unused 
or those which returned a proportion of the questions due to 
limited number of teachers who have participated^ and counties 
which did not return questions due to lack of participation, 
the expected return was 43 0« Of the 430 teachersr 304 
respondedr resulting in 68% of the expected return* This was 
considered adequate after three letters of rmlnders within a 
120 day period did not increase responses. 

Students 

Sampling of students was limited to case studies in view 
of the constraints already discussed* A small number of 
students who participated in projects selected for case studies 
were interviewed or given a short questionnaire to fill out* 

Adequacy off Samrte Size 

The adequa^ of the sample si^e was based on proportional 



raturn and atatiBtical application. The atatiatleal teste used 
corraspondad to tha leval of maaauramant nominal and ordinal. 
Chi-^uare fraquanqr distribution and crosstabs statistics ware 
amployad. 

Givan four dagraas of fraadom based on most of the 
ijuastlons (S-point acala) ^ two groups (teachers and 
aaninistrators) and the characteristics of tha population^ a 
stringent alpha level of .01 was choaan with a moderate affect 
sisa of 0.3. With the above establiahad, Cohen's^ powar tables 
for Chi-square at alpha of .01, 4 degraas of freedom, required 
a aampla size of 350 to achieve a maximum power of 0.99 or 99%. 
Thua, the corobinad size of teachers and adminiatrators (362) 
was considered adequate. 

Three atrategies were used to conduct the stu<^f survey 
quaationnaire; caaa studies^ and project reviews. 

Sarvev Quest loimal re 

This waa the most important emphasis of the stucfy. The 
questionnaire was constructed from the research objectives and 
administered to atoiniatrators and teachers. The responses 
ware analyzed using Chi--aquara for compariaon between groups 

^Cohanr Jacob (1977) * Statistical Powar for the 
Behavioral Science , (p. 229) * Naw YorKi Academic Press. 
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and crosatabulation for frequan^ distribution and aummary 
tab! as. 

Case Stiidiea 

The purpose of the case studiaa was to determine factors 
that promote or inhibit projects ef f eetiveness. This was 
achieved by interviewing project directors and sample 
participants with respect tos a) how well the project achieved 
its goalsf b) identify strengths and weaknesses of the project^ 
c) determine the usefulness of the project? and d) make 
recommendations that may benefit future projects* Nineteen 
projects were selected based on ''Good examples'* and "Not so good 
examples** of 310 projects* The judgement was based on the 
experience of the Bureau of Adult and Community Education staff 
and project records. Summary descriptions were used to present 
findings* 



Project Rwleifs 

The intent of the project review was to compare the 
national and state goals for 310 projects, and to determine how 
well 310 projects have addressed these goals* Another purpose 
was to determine the scope of 310 projects and how the process 
of the administration of 310 projects may be improved* 
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Stsangtha 

The major strengths of the projects were in the racruitanent 
and retention of students, material dev^elopnent, continuity of 
project activitiee and teacher training efforts. 

Recruitment and retention was unanimQusly re^rtad as a major 
problem In adult education* Present evidence indicated that 310 
projects have contributed immensely to improve recruitment and 
retention efforts of various progrms* However^ there is still 
much to be done to improve recruitaent and retention. 

Material develowfient ^ whether original or modification of 
existing onesr is an important aspect of 310 projects* 
Especially in view of the fact that the materials were developed 
directly from experience with learners or users* Most of the 
materials developed and disseminated have been found to be useful. 
Howeverr work is still required to improve the quali^ and the 
dissemination of the materials* The major recommendation concerns 
developing materials that are usable by other programs* 

Continuity is one of the outstanding features of special 
demonstration projects* The few projects which had contlnui^ 
plans were very successful* These projects had activities that 
were adopted by the parent Institution, Projects of this nature 
are exemplary and should be encouraged* 

Teacher training is a major component of 310 projects* The 
result of the case studies indicated that teacher training 
aetivlties were well accepted* However, more teacher training 
efforts are required to update practitioners of methods and 
technlqueSf and materials In adult education* 
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Thm following are the major weaknesses of the projects. 
1. Planning was the most common problem* Planning problems were 
in the form of lack of syranetry between goals, objectiveSf 
plans of action and evaluation* A major cause of the above 
problems was in the Inexperience of some of the grant writers 
and poor implementation efforts. This observation is supported 
by the recommendation of some of the project directors that 
grant writing workshops be conducted, 
2^ Pollow-up aetlv^itlas were neglected by nearly all of the 
projects* This was due to lack of funda and scheduling* 
Although moat project activitiea were terminated at the end of 
the fiscal year^ a follow-up plan should have been conducted 
at about the third quarter of the projects Of course, thia 
Buggeation may not apply to all projects, A possible solution 
would be to complete all of the intervention early enough to 
allow for some follow-up atu<^, even if it meant a random 
aample of participants by letter or telephone converaation* 
3. &valumt:ion waa conducted by moat of the projects but waa 

plagued by methodological problema. For example, attitudinal 
change was the most conmion focus* Evaluation activities 
should have included, for attitude measure, pre- and 
post-teat; and for content specific meaaure, objective 
referenced evaluation* 
4* Dlsseminatldn aQtl^ltiee were limited, in moat cases, to 

statements and project activities and results which were sent 
to local adult education directors* The limited number of 310 
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pro j eat materials found in the centers visitedr imply 
Inadequate dissemination efforts* 
5* Continuity of projeat activities by the parent institution or 
other designated bodies was not achieved by most of the 
concerned projects. Evidence of continuity is necessary to 
give credence to projects of the special demonstration of 
nature* 

6* Reaatlon of project directors was on two issues s release of 
funds and dissemination* Most of the project directors 
interviewed indicated that actaiinistrative protocols prevented 
timely release of fundsr which resulted in delayed projects* 
There was also a concern that 310 project materials and 
program activities were not properly advertised or publicized* 
Overallr all of the project directors felt that 310 projects 
were helpful to adult educational activities* 

Recomandations for Iffiprovmeiit 

The following recommendations are proposed by the participants 
to improve the effectiveness of future projectsi 
1# Needs Assessment 

h needs assessement is reconunended for all 310 grants to 
establish the problemr examim^ constraints (human and material) r 
and indentify methods-means to implement the project. 
2 * Goals and Obiectives 

Goals and objectives should be derived from needs assessment 
results* There should be a logical transition from goals or 
purpose to objectivesr and from objectives to activites* The 
objectives should be specific enough to be measurable* 



3 « Evaluation 

Evaluation should be conducted to assess the effectiveness 
of the projects. 
4. Follow-up 

Follow--up plans should be include^ to meaaure impact of 
the project, 
5 ^ Dissemination 

A plan for dissemination should go beyond just mailing out 
information to all local directors^ to include identifying the 
primary audience and informing the audience about the nature of 
the products^ 
6* Materials 

Blaterials which are produced ahould not only be of good 
quality but should be of the appropriate reading level and graphic 
layout to enable users to benefit from the materials. 
7, Documentation 

It is important that project activities be documented 
systematically. The record should include names and addresses 
of participants and other routine records of a project. Copies 
of the records should be accessible to the parent organisation 
for future reference. tophasis should be focused on the 
implementation process. Care should be taken to document the 
strengths^ weaknesses, probl^s encounteredr and to recommend 
how the process may be improved for future adaptation or 
adoption, 
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Project Reviews 
project review aetivltsr consiated of analyzing national and 
state priorities for 310 projectsy scope of 310 projects? and the 
adninistrative process of 310 projects. 

National and state priorities for 310 projects \iare compared 
and found to be similiar. This implies that the activity content 
of 310 projects are in agreement with national goals and purposes 
for 310 projects. 

Scope of 310 project activities were categorized into four 
typess special . demonstrationr teacher training, dual purpose 
projects and special projects. Analysis of these categories 
revealed a fairly balanced distributions special demonstration 
(30); teacher training (28),. dual purpose projects (8) and special 
projects (2). when the distribution was analyzed by years, it was 
found that the proportion of special demonstration and teacher 
training projects remained fairly stable. Understandably , the 
proportion of dual purpose projects were unstable. This signified 
the specific role of special purpose projects. 

Another aspect of the analysis was the distribution of subject 
natter. In the-special demonstration category, adult basic 
education curriculum and materials, literal skills, type 
projects, and outreach progrMis seemed to dominate the ^pe of 
projects funded most frequently. Student recrulfanent and 
retention, computer-based instruction and functional skills were 
low in frequent of funding. Based on the results of the survey 
and case studies, recrulfanent and retention and computer-based 
education should be given serious consideration when selecting 
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projecta in the future* 

The fflnphaals on taacher training projects were mrnlnly on 
materials usage and on methods and techniques of Instruction. The 
demand for more teacher training activities as Indicated In both 
survey and case studies findings Is a possible indication of the 
number of teachers who are yet to be reached* 

Evaluation of proiects was treated in terms of instrtimentation 
(quarterly reports) * The current instrument is strictly based on 
self- report by the project directors - a condition that may allow 
for excessive subjective information. While it may be difficult 
to avoid subjectivl^^ the evaluation may be improved by including 
more content specific questions that relate to project objectives 
and timelines* In addition^ the end-of- project report format 
should be revised to allow for more dascrlptive information* 

The present monitoring process appeared to be appropriate^ if 
projects were contacted or visited two to three times during the 
implementation period* The main suggestion to improve the 
monitoring process involved modifying the current instrument to 
include more open-ended questions* In addition^ visitation 
reports should be sent to the project directors to use as guide to 
successfully complete the project. 

Grant award and committee selection were found to be 
appropriate* Boweverr it was suggested by the staff of Bureau of 
Adult and Communis Education that conmittee mrabers should not 
have sutoitted a proposal for the fiscal year of their 
appointment* To further improve the selection process, previous 
project titles and abstracts should be given to the committee to 
avoid duplicaLtlon of activities* 
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overall Conclueion 

The gansral purpose of the stu% was to deterinine the impact 
and scope of 310 projects on adult education in Florida* The 
overall result of the stu^ indicated that 310 projects have made 
a significant contribution to Improve adult educational activities 
in Florida. Specifically^ the greatest contribution was made in 
individual progrsunSr recruitaent and retention^ and staff 
development* Generally^ a notable contribution was made in 
niater 1 al dev el opnent . 

Individual adult education programs have improved various 
aspects of their educational activities by using 310 project funds 
to resolve prograimatic problCTis that, otherwise, would have been 
difficult to resolve through existing resources* This 
contribution may be further appreciated by considering the public 
awareness created through community involvraent, the increase in 
enrollment and the instructional materials developed or acquired. 

Recruitment and retention requires a specific effort in human 
and material resources to successfully accomplish* The result of 
the stu^ indicated that marqf programs dramatically Improved their 
enrollment through the opportunities created by 310 projects* Of 
particular interest were programs that continued after the 
termination of 310 project funds* 

Staff development efforts mainly involve educating teachers 
and a^inistrators on materials, methods and techniquesr and new 
processes in adult education* The result of the stuc^ showed a 
positive reaction towards 310 project staff developnent programs* 
Generally, teacher training projects seemed to have impacted on a 




bEoadar range of participants than special aeraonstration projects^ 
The participants demand for more staff development projects 
raflects the current national trend* According to the report of 
the United States Department of Edueationr Division of Adult 
Education^^ in FY 1984, staff development was the top funded 
priority (approximately $1^3 million ) area nationwide^ 

Generally r 310 project materials have been read and used for 
instructional purposes^ However, it should be rraiembered that the 
effectiveness of the materials was not directly determined for 
practical reasons: inadequate dissemination^ problem of locating 
and matching materials with users; and modification and 
repackaging of materialsti The finding of the stuc^ indicates that 
the materials which were disseminated were read and used by the 
majority of practitioners who received them* 

Although the general trend of the responses indicated a 
positive impact of 310 projects, there were specific programmatic 
component of 310 projects that reguire attention. The areas 
include dissemination of products and exemplary programs^ 

Dissemination activities were not effective in making all 310 
products available to the intended target j^pulation* Discussion 
with project directors and local adult education directors 
revealed that the absence of a resource list of 310 project 
products was response for the limited use of the products^ It 
appears, theref ore^ that with improved dissemination efforts use 



^310 Self Assessment, USDOE, Division of Adult saucation, 
December, 1984 
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of 310 projacfe products will inereaaa. 

Examplary programs have not had the dasirad affact^ such as, 
in sharing expariences with othar adult education progr^s. 
Sharing results will be banaficial in reducing tina, effort and 
resources in resolving program problems. The reason for this 
problein was inadequate dissemination efforts* 

In retrospact^ 310 projects have a specific role to play in 
improving adult educational practice. As a competitive grant, 310 
projects will continue to provide opportunities to individuals 
with insightful ideas and programs with problems of common concern 
to make contribution to the i^rovwoent of adult education 
statewide and nationally. 
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FOCUS on curriculEim 




FOOnS am eurgjgulisB AMBTBA^ 



This 310 BpmaLml Prsject was funded at $12,744 from July 1, 1984 to June 
30, 1985 cat 

(1) wmv^LmM tmn years of Pennsylvamia's 310 i^teriali and 
publish six FOCUi an eurr ieulam Bulletins describing 
outstanding projects; 

(2) prepare a 1985 addendum E© PA*s R&E Listing of publishers* 
maCerials for adult edueatian. 

Froduets inelude the FOCUS Final Report, si% FOQUS Bulletins 
featuring e^iemplary FA 310 Speoial Projects in the areas of: 

* CBAl CCompetenoy^Based Adult Education or lifeskills); 
^ ISL (English as a Seepnd Language); 

^ ^iplo^aenti 

* Literacy; 

* Madia and fechnology 

* Special Populations. 

and a Resource Listing made up of thiry^si% exemplary 310 projects 
reviewed in FOCUS pLus 121 publisher resources with 1980# publication 
dates in the areas of BASIC READING ; EEL; ABE; CBAE; PHE-i^D and GED« 



FOCUS BPLLETIHS 

Five Pennsylvania adult educators and the FOCUS editor reviewed 
ten years of 310 projects in the six curriculum areas noted above # All 
members of the review panel had extensive experience as 310 project 
directors and/or resource managers^ Criteria for review were those 
initiated by the UiOE*s Clear inghouae ADELL in FY 1978-1979. The 
three major selection indicators for inclusion in the FOCUS Bulletins 
werei Effectiveness, Innovative Qualities, and Adoptability, 
Thirty-'five 310 projects were deemed exemplary and featured in FOCUS* 
Six Bulletins were published between October 1984 and April 1985 and 
distributed to Pennsylvania adult educators ^ state directors of adult 

education and state » regional, and national clearinghouses « 
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A Reader Survey wm^ mailed iriEh the April FOCUS Bullecin Cs 800 
readers. The reattlts, esmpiled May S, 1985, from a return of ©ver 10 
percent^ appear as Appemdix A. Briefly mimm&rimmd^ FOeuS reached mainly 
adminig trators of adult edueatioa progrras ia 1©m1 education ageacies, 
whose major intterast was Literacy resoureea. Out of a possible rating of 
18 points for the six areas surveyed C Organized, On ders taadable. 
Informative, Interesttiag J Useful, Rewarding), FOCUS received aa average 
total of 15p65, Aaother iatereat indicator was that IS percent of the 
respoadents requested additional FOaUS bulletins. 



The best evidence of the ef feetiveaeas of any dissemiaation project 
lies ia the requests for the material it is publiciEiag, The reader 
survey mailed with the April issue iadicated that over a third of the 
respondents had requested the loan of seveaty-seven 310 projects with 
Literacy resources oage again leading the list. An informal cheek with 
310 Project Directors brought to light not only adult educator interest 
but two inquiries from publishers. The AdvancE Clearinghouse reported 
that, as of the beginning of June, they had responded to 102 requests 
with High Tech and Media resources leading the way. 



1985 MR BlSOPmre LISTCTO 



FA 310 ME LISTINQ 1985 



CD NAiffi: FEOJICT DSIVl 



a) PROJECT DIE: 
(S) ORGANIZATIOH 



C7) CONTAOT: 



*ih€rry Eoyce 
Lancaster ^Lebaaon lU 13 
BoK 5026 

Laacaster^ PA 17S01 
Doris Zook 



(2}AIEA ESL 
U)YEML 1979 

U)m *t 3025-79A*! 

(t) TELi (717)569-8561 



(9) AUDIINCI: T, L 
C11) Sub-Area I eiAI 

(12) COMPONlNTi G 

(13) PROJICT COST $4,071 



(10) PA^IL mVtm 1984 

(A) Effectiveness Q 

(B) ZnnpvatioB S 

(C) Adaptability £ 



(14) COieilNTi I Eight cenqietency-based progrOTed booklets 4 guide provide information 
4 exercises on driving and car maintenance. Key words and idioms are set off in 
Italics £i a Spanish & VietaaMse glossary is included* Guide has suggestions 
for added drills. 
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ThirCy*five exemplary projects famtured by FOCUS have been 
described in Che 1985 R&R Eesaurce Liscing. Each listings as 
illustrated on page 2, provides a brief description of the project and 
a contact name and address for more infomatioa. The areas numbered 
1*14 inclndei 

The title of the 310 Project used in the FOCUS 



1. NAME 

DIEECTOR 



4. TCAE 



5, ORGAN, 



6^ AE # 



7^ CONTACT 



TELEPHONE 



9^ AUDIENCE 



lulletia^ 

Class if icmtion used to identify mjor cnrriculum 
thrust of project and product « 

Individual responsible for project development 
and administration. In wst eases, the CONTACT 
(7) person remains the project director. 
However, a * denotes that the director is no 
longer available. In that case, the name and 
m^PHONE Ci} of an alternate is provided. 

Year in irhich the project was completed and the 
final product provided to the AdvancE 
Clearinghouse. Projects that have a July 1, 1912 
^ June 30, 1983 fiscal year will be labeled as 
1983 products. 

Name and address of the organizacion j^nded to 
develop the 310 Special Project. 

This desigttaces the Adult Education number by 
which the project can be borrowed from the 
AdvancE Clearinghouse, PDE, 11th Floor, 333 
Harket Street , Harrisbwg, PA 17108, 

That individual with special Imowledge of each 
particular projecti where a current contact is no 
longer, available^, the AdvancE Clearinghouse is 
suggested. 

The phone number at which the contact can be 
reached. 

Project products such as the final report and the 
curriculum or teachers' guide are best suited to 
different audiences. Thm audience code isi 
A ■ administrators I T ■ tutors /teachers | 
C ■ counselors I L * learners. 
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10. PANEL 
REVIEW 



11, aUB-AMA 

12, dOOTQNENTS 



13. coeT 

14* COW^KTS 



The year in whieh the panel review was eonducced. 
Each prDjeet was rated for (a) Ef feeCxveness ; 
(B) Innsvacion, and (G) AdapCmbility. 
E ^ excel lent; S ^ superior; G * good, F ^ fatr. 
Only projects with ratings were reported in 
FOGDS Bulletins and are included in this listing. 

An additional product interest or area of use 
beyond that identified as AHIA C2)- 

A list of the products available from Advaocli ^ 
C ^ Currlcultm for learners or ataff; Q « guide; 
AV Media or High-Tech eomponent; FR ^ Final 
Report. Is most cases , the guide is attached to 
the curriculyan or final report* 

Funding for the project as reported by PDE's 
Division of Adult Basic Education. 
A brief description of projects* goals, products, 
and/or results. 
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FOOOi EVU^ATIOH lEFOEX 

A Eeader Survey was enclosed in the April FOCUS Bulletin and 

mailed to 800 t m&dmTB » The following inforaatioa was eonpiled Hay 5, 

1985 from the data returned to the FOCUS editor by over 10 percent of 
those surveyed « 

Analysii of Reader ship 
A. FQCDS respondents hold the following positional 



i3 % Administrators 

12 Ins true tors 

3 Business /Indus try tr miners, managers 

2 ReseareherSs oonsultants, AE professors 

B. The institutions to whloh FOCUi respondents belong mrei 

39 % i^As 

12.5 State Depts. of Education^ lealth and Mlfare^ etc, 

11 Colleges and Universities 

11 CBOs 

6 Correctional Inscitutions 

4 Business and industry 
4 Hesearch Centers 

2«5 Others 

Responses by state to FOCUS survey indicates 

47 % reside in the Commonwealth of Pennsylvania 

53 represent 22 states and the District of Columbia. 



READER INCHESTS 

A* 85% of readers surveyed requested additional FOCUS Bulletins. 
Of these: 

85% requested Bulletins devoted to PA 310s. 

84% asked for Bulletins featuring other states 310s. 

B* On an average, FOCUS readers received five of the Bin bulletins 

issued in FY 1984-85. Of those replying to the survey, 55% indicated 
their favorite issuesp and 92.5% completed the ratings. 
The preferred topics werei 



40 % Literacy Resources 

14 ESL 

12 CBAE 

12 Employability 

8 Media 

8 Special Populations 

6 Considered all issues good. 
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FOCUS_ RATINGS 



A four poinc rmCiag leale was used zq avalu^ce thm FOCUi 
Bulletims wieh 0 ms thm lowasC passible racins and 3 aa thm 
hlfheae« OuC of a passiblg 18 peinci for mix areas surveyed, 
FOCUi reaaived m avaraga £sCal scpra of I5.64« 

A* Xmdividual arai^s avarmgad as follows i 



2.82 OftOAHIZED 

2 . 79 UNDlEItANDABI^ 

2*74 INFOEHATIVl 

2*59 WTEMEBTim 

2.J8 VBEW^h 

2.32 mWAEDIHG 



B* Thm af f accitranass af cha FOCnS Bullatiaa was avaluacad hy 
datarminimg how wall tha Imformacion providad u^shad raadar 
iaCaras£s. Eaadars wara askad tm oark what resoursas thmy war a 
looking for im 12 araaa; ud Co indicaca ^ae rasourcas thay had 
Tmami'^md from FOCUS. Of nbosa ra^urniag tha survay^ 99% addraased 
this quastion. 

% mSFONDlNTS LOOKINQ I OF TmSE LOOKING 



FOE: 




WHO RECEIVED: 


€0 % 


Dlffereat Ideas 


S5 % 


60 


New Teehniquas 


73 


58 


iBscznecianal Maeerisls 


SO 


56 


Xsereaaed Undecscandiag 


91 


45 


Staff Develapmene 


fil 


36 


AlCermaclve Frocedures 


S6 


21 


Curiosity Sacisfacelon 


52 


20 


General ImforBation 


100 


18 


NoehiBg Pareieular 


10 


14 


Concepc ReiBfof cenent 


55 


9 


Diseusaion OpporCuaicy 


71 


2,5 


Other 


100 



4. MADER RlCQ»ffiHPATIOHi 

Although tha survay isdicatad that eo^ancs wara optional, S2I of 
raspondants offarad raeommndatioQS and eonrnQdations. Thasa 
fall into tha araas oil 1) ganaral apinioni 2) FOCUS formati 3} 
FOCUS contant; 4) FOCUi followypi a) acquisition of materials 
racommandadi and h) usage of information reeeivad, and 5) 
raoommandations for tha future. 

A. Ganeral oos^ndations ware offarad by 45% of raspondants. Host of 
tha aosoiendations ware in tha following vaini 

*Excallant job. Kaap up tha good work. Well organized, simple , 
easy to raad^ Thanks I 
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B. A faw readers indiemcad whaC Chay appreelaced moac, 

*I think Che idea ©f featuring 310 prejeets is axeallast. It 
has bean an Invaluable source Co me« 

^*nraka for making the response an easy task^ 

*YQuif project was, as usual^ well done* I think it provided an 
excellent service to the field at a reasonable cost, 

*Thanks for your consistent mailings* 

*1 have appreciated very much being placed on your mailing 
list. It is the best publication that I receive* Hopefully, all 
program operators are receiving FOCUS - 

C« Comoencs dealing with FOCUS format zeroed in on making the bulletin 
easier to read: 

*Reading FOCUS is difficult* Tkm color and lack of art work do 
not encourage reading. TOe color is very hard on my eyes. 

♦Suggest more headings ^ center and side ^ easier to extract 
information. Also initial paragraph all in cmps was hard to 
read, 

^Features of FOCUS I particularly appreciates 1) Brevity of 
each d.:^scripEiQn J of entire bulletin. 

D. Commencs regarding FOCUS* concent were overwhelmingly complimentary 
and are reflected in the general opinion section. Specific 
suggestions for improvement and coimBendacions include i 

*Too many acronyms. What is APLj CBAE, PDI? A saiz^le page 
would "grab" me more than amount and source of funding. 

*I don-t find FOCUS useful because it was not critical in its 
ratings. If everything is good, excellent, or superior. .. forget 
it. Ho use being picky, huh! 

*I especially appreciate the three different kinds of ratings 
with each one clearly defined. This helps me to make decisions 
quickly, 

*Very nicely edited. 

E« The response by readers to materials featured in FOCUS was 
gratifying. Over one-*third of those responding indicated that they 
had requested between one and six special projects each, ^eir 
experiences in the process of materials acquisition have been 
varied, and their coments , enlightening. 

♦More information on how to obtain materials would be helpful. 
Also I could not find a telephone number on FOCUS to call for 
general information. A number would be helpful. 

*Some of the 310 developerg were no longer with the projects. 
You might want to update project director infomation. Those I 
reached were most helpful. 
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*I borrewed chree projeets* I would have liked co espy Che 
tmpmm and omcerialt for bfiginaimg resdingj but I dida'C have 
Che zimB CO da ic. 



*I appreciated jQur prempc t mspotiB ivmmmmm che onm timm we 
requesCed ca barfQw pTQjm^t daCa» 

^tC Caok ac lease eighC weeks c@ get thm maCeriala. 

^•iame frugcraciom arase when eQacaccing iadividiial 310 project 
direatars. Addlclonal inf arisacian , particularly aasc and 
avmilabillcy I was hard ca gec. Only Advanel responded. 

FOCUS was aiii^d aC adBinis tratars , staff and curriculum development 
specialises s and insCTOctars warkiag with che ABE populaCian. For 
the aast parc^ canraenCs an the use of the Bullecins indicace that 
Che circulation was oa CargeC and FOCUS was dissemiaaCed 
extensively by lea recipients « 

*FOCDS is an easy way ta get staff involved in che AdvancE 
collection^ (ABE frogm Director) 

*The usefulness was down only because sy very narrow needs were 
not met. If I still ran a progrra, I suspect my response would 
be difference (Publisher). 

*I have given FOCUi co our acquisition coardinatar* It is most 
helpful for us ca use in "solicicing" materials for EEIC. I 
will also keep chea as part af my reference file. (IRIC^SU) 

*It wauld be aost helpful Co receive more copies or far yau to 
send FOCUS Co ocher adminiscrators directly* (State Dir. ABE) 

*We , in Illinoiss used this valuable infarmacion through our 
servic^j center netwark. The rewarding aspect af this professian- 
al develapaent service was that your cantribuclons co further 
understanding were used. 

As noted under Reader Incerescs (ieccion I), SSI af survey 
respondencs asked for a contin^tion of FOCUS. Of chese^ 851 were 
interested in mare informac ion about FA 310s and 84% asked for 
infarmacion about other states' prajects. The degree of incerest 
was born out by their cooments. 

^fCeep up this excellent 'sharing' tool. 

*This should be duplicaced in all s cates ta disseminate 
309/310 projects. 

think ic went a long way in disseminacing infaraacion on 
worthwhile resources which is greatly needed. 

*Please send me the October ESL FOCUS . I missed ic. 

*This service is useful in getting 310 prajects off che shelf. 
Hare help is needed beyond the scope af FOCUS in iDplemencation 

*An excellent prajecc with widespread disseminatian* . .Keep up 
^^^^^^ ■ t Clear^ly deaonstraces the wisdom af goad 

:.€e^unicatian8. 



R « R 310 RESOURCE I.ISTING 



TITU; ORGAHlZAtlQN AE NUHISR 

ABl EMPLOYHENT ORIIOTED CURRICULUM 1984 Liaesla lU II, Ism 70 3025*330 A-S 

ABl HIGH TECH CURRICULUM CUIUS 1984 CouderipsrE Area iD 3025-322 A-E 

AFL HADE ZABt 1979 Latte«icer-Ub*Mn lU 13 3025-75 A-1 

BASIC SKILLS HAUE EASf If 82 Lamsaiser^Lcbaaaa lU 13 3025-262 A-B 

BILIHGUAL CAREEE QtFLORAXIOR ^EKBIDF 1981 Hi«p«Bic FraJecESt HAAC 3025-193 

BUILDING A BETraE YOU 1980 Msa ValleT Frefreaa Caune, 3025-88 A-B 

CQHFllTER CUIDE h SYSTEMATIC i^FRDACR TO ^ 82-3 Sheundoah Valiey SD 3025-267 A-i 

COHiUHEE HATH CURRIC* FOR 0-4 ABE STUDEHT 1983 Ed.Div., U af Fig^sburgh 3025-292 

CURRICULUM IH SIFLOYI^HT 1983 LuehersB ieetlmraE Hsuae 3025^290 A-B 

DIRSCtORY OF VIDEO USOURClS 1984 The Fens iCace miwmtnitj 3025-321 A-B 

ESL HADE EASY 1981 LatisaaCer-Lebanan lU 13 3025-293 A-B 

ETHNIC HERITAGE i AffiRICMIS 1982 Ed. Div. , U of Fisiaburgh 3025-228 A-B 

FtJHCTIONAL LANGUAGE READING FROGRAM 1985 Adulg Ceotmls^ Frep Frsg 3025-328 A-0 

JOB CLUB CURRICULtm 1984 Harriaburg $tm%m Haapisal 3025-329 

JUST A STEF AWAY 1982 Alcsena Seheoi DisErisc 3021-263 A-E 

LAHGUAGE ARTS FOR SEGIHNERS 19§3 LaQeaaCfef-Labafion lU 13 3025-298 A-B 

LEARNING FOR OLDER ADUL^ 1982 FA S#Bi@r CeBCer iDaticuge 3025^254 A-B 

FA HIGRANT ADtrLT CURRICULm RESOURCE GUIDE 1975 UtmymT IdueacisM Censer 3025-39 

FEER TUTORING FOR TIE FHYSICALLY RiUfDlCAFFED 1984 Good Shripherd Home 3025-347 

FROJECT CONNECT 1982 HelpLisiJ 3025-235 A-B 

PROJECT DRIVE 1979 LiO€aa£ar«Leba6oii lU 13 3025-79 A-I 

FROJECT GRADi 1983 Huagingdsn SCI 3025-337 

FROJECT LEARN-MAN 1983 CIU 10 Adult Dev. Center 3025-33S 

FROJECT LURE 1981 CIU 10 Adult Dev, Cancer 3025-227 A-B 

FROJECT READ 1984 CIU 10 AdulE Dev. Center 3025-341 

FROJECT REASON 1983 CIU 10 AdulE Dev. Censer 3025-305 

FROJECT SECOND CHANCE 1984 Hamburg Sohool Diatriss 3025-304 

PROJECT SUFPORT 1981 Frojees ACCESS 3025-170 

FROJECT VOTE 1982 HaTriabusg State Hoapical 3025-236 A-C 

SAVING OUR RESOURCES 1979 Ed. Div. , U of FiCtaburgh 3015-58 A-B 

TEACHING LITERACY THROUffl AH ORAL TRADITION 1984 Lutheran Settlnens Houae 3025-362 A-B 

tECHNIQUES rOl TEACH. VI SIOH-Uff AIRED ADULTS 1983 Dept. of Publio Welfare 3025-319 A«B 

THE ADULT STUDENT MAQA«NE 1979 Tana Reiff-iodano 3025-90 

WHAT YOU SHOULD ICNOW ABOUT RAFE 1980 Con« Rea. o£ Fayette Cntj 3025-135 A-B 

VmAT'S ON YOUR MIND? 1933 La Salle Urban Studiei Cti' 3025-286 A-3 
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PA 310 R&R LISTING 1985 



NAME* APL MADE EASY 



PROJECT DIR^ 
ORGANIZATION 



CONTACT I 

AUDIlNrai A,T 

Sub'Area.' 

CQ^^ONENTS 
PROJECT COST 



*Sherry Reyce 
Lsacaster^Lebanofi lU 13 
Box 5026 

Lancaster, PA 17601 
lU 13 Adult Iducatioa 



FR, C, Q 



AREA CBAE 
YEAR 1979 

AE #^ 3025^75 A-B - 
TOL: (717) 569-8561 



PANEL MVIEW 1984 
Ef fie€Clveii@ss S*^ 
laoovaelQQ E 
Adaptabilicy 1 



COKSNTSi This eurriaulum^ basad an a acudenc/gaaehar/gossunisy survey of nmmdmd 
AJPL skills y providai 100 leasoo plan cards thmt address che five APL areas. They 
assist Che tutor/ceaeher to integrate aMdemia skills with lifeskills is a CBAE 
format. 



PA 310 R&R LliTING 1985 



NAKE^ PEOJICT CONHICT 



PROJICT DIE: 
OEMNIZATIOli 



CONTACT: 



Walsh Fogoros 
Ha IpLine 
200 Ross Street 
Pittsburgh s FA 15219 
Project Director 



AREA CBAl 
YEAR 1982 

AE #1 3025*255 A-B 

TOL: (412)255-1140 



AiroiENGEi A, C, T 

Sub^Areai 

COOTONENTS FR, G 

PROJECT cost 15,000 



PANEL REVIEW 1984 
Effectiveness G 
lanovatlon G 
Adaptability G 



CO^^^NTSi This 120 page guide to coimaunity resources is organized according to 

the 5 APL areas. Listings include agencies, businesses ^ organizations willing 

to provide services or literature to adults. The format could serve as a model 
for any comunity. 



PA 310 RSR LliTING 1985 



NAffii 



PROJECT REASON 



PROJECT DIE: 
ORGANIIATION 



CONTACT: 



Nancy Fogelman 
CIU 10 Adult Dev. Center 
Centre County AVTS 
Pleasant Gap, FA 16283 
Edie Gordon 



AEIA CBAE 
YEAR 1983 

AE #t 3025-305 

TELi (814) 359-3069 



AUDIENCE I T.C.L 

Sub-* Area I 

C0^O»0NENTS FR, G 

PROJECT COST $6,840 



PANEL REVIEW 1984 
Effectiveness S 
Innovation E 
Adaptability £ 



CO^^NTii The Teachers' Guide to Reasoning presents a 4-itep color-coded process 
for problem solving. Students learn to attack everyday problems such as choosing 
an apartment or losing ten pounds by working through eight smple units using a 
unique hands-on approach* 
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PA 310 MR LISTING 1985 



NAME: PROJECT SECOND CHANCE 



PROJECT DlRi 
ORGANIZATION 



CONTACT I 



Hamburg School Discriet 

i Mburg, PA 19526-0401 
Harcia Qizm 



A, T, C 



AUDIENCE t 

Sub^Ares: 

COOTONENTe 
PROJECT COST 



FR* C, G 
$31,352 



AREA CBAE 
YEAR 1984 

AE #: 3025--304 

TEL: (215)779-7111 



P^EL REVIEW 1984 
Ef fee civeness S 
lanavmtion S 
Adspcabilicy 6 



GOHMENTS^ This comuaity effort mnlimtmA business , trmiaing program, Vo^Tach 4 
school districts in a CBAE program leading to the awarding of a local H8 diploma 
to adul£ learners e It used an individualized curriculum based on learner needs, 
background 4 situation. 



PA 310 R4R LISTING 1985 



NAIffi: SAVING OUR RESOURCES 



PROJECT DIR: 
ORGANIZATION 



CONTACT: 



Dr. Robert Zellers 

Ed* Div.j U of Pittsburgh 

Johnstown s PA 15905 



Project Director 



T, C, L 



AUDIENCE I 

Sub^Areai 

COOTONENTS 
PROJECT COST 



C, G 

$4,953 



AREA CBAE 
YE^ 1979 

AE #1 3015-58 A-B 

mhi (814)266-9661 



PANEL REVIEW 1984 
Ef feeciveness S 
Innovation S 
Adaptability S 



COtOffiNTS I The 45— page booklet presents a clear, concise picture of energy usage 

and conservation. The language^ though simple, is adult; the facts interesting 

and the examples drawn from situations relevant to adults • The guide suggests 
additional resources* 



PA 310 R4E LISTING 1985 



NAM: WHAT YOU SHOULD KNOW ABOUT RAPE 



PROJECT DIE I 
ORGANIZATION 



CONTACT : 



Chari Kronlck 
Com, Res, of Fayette Cnty 
78 Morgancown Street 
Uniontown , PA 15401 
Project Director 



AREA CBAE 
mML 1980 

AE #1 3025-135 A-B 

TELi (412)438-^1470 



C, T, S 



AUDIENCE t 

Sub-Area I 

COMPONENTS 
PROJECT COST 



FR, C, G 
15 ,000 



PANEL REVIEW 1984 
Effectiveness S 
Innovation E 
Adaptability E 



COI^ffiNTSl An easy-to-read, straight-talking booklet for adults that covers all 
aspects of rape including harassmenc on the Job 4 talking co children about the 
prevention of sexual abuse* Guide focuses on dispelling myths and offers common 
sense prevention tips. 



-41- 44 



FOCUS on curriculum 



VOL. 1, 
MARCH 



NO. S 
1985 



St«rry Royce^ Editor 



MATERIALS FOR LITERACY EDUCATION 

THIS BULLETIN IS THE FIFTH IN A SERIES OF SIX HIGHLIGHTING 309/310 
MATERIALS DEVELOPED BY FENNSYLVANIA ADULT EDUCATORS SINCE 1975, DURING 
THE PAST TEN YEARS r PDE'S DIVISION OF ADULT EDUCATION HAS AWARDED 
5580^365 TO 45 SPECIAL PROJECTS DEALING WITH LITERACY EDUCATION, 15 OF 
WHICH WERE FUNDED FOR 5104^997 DURING THIS FISCAL YEAR. A PANEL OF 
EXPERTS REVIEWED 17 OF THE PREVIOUS 28 PROJECTS AND SELECTED SIX AS 
USEFUL FOR ADOPTION BASED ON CRITERIA DEVELOPED BY THE ADELL CLEARING- 
HOUSE ( 1 979-1 980 ) * MATERIALS CHOSEN SCORED HIGHLY ONi EFFECTIVENESS - 
OBJECTIVES AND OUTCOMES CLEARLY STATED, MATERIALS LINKED TO RESULTS, 
CONTENT APPROPRIATE FOR TARGET AUDIENCE? INNOVATION - ADDRESSES MAJOR 
PRIORITIES f CREATIVE USE OP RESOURCES , CONTENT NOT COMMERCIALLY 
AVAILABLE; ADOPTABILITY - CLEARLY WRITTEN^ LITTLE STAFF TRAINING 
NEEDED TO TRANSFER, MATERIALS LISTED ARE AVAILABLE FOR LOAN FROM 
ADVANCE r PA'S ADULT EDUCATION CLEARINGHOUSE, OR FOR SALE FROM PROJECTS 
AS LISTED, 



BASIC SKnJLS MADE EASY 

Developed by i Irma Drumm, Pat Latshaw and Gail 
Trendler; Sherry Royee, project director* Lancast- 
er Lebanon ID 13 Adult Education , Box 5D26f 
Lancaster f PA 17601* $20 per set. 

Bag ie Skillg Made Eaa^y was developed to 
assist ABE Eeachers and literacy tutors 
to integrate survival skills with basic 
reading and math within the framework 
of one lesson* This project is one of 
a series of three HADE E^Y 310 curric- 
ulum development projects. E8L 
EASY was reviewed in the October issue 
of FOCUS, APL MADE ^SY^ for 5-8 ABE 
students, will be featured in April. 

Funded at $4,963 and completed Septemb'- 
er 1982, this project includes a 
Teacher's Guide and 100 lesson plan 
cards dealing with specific life skills 
topics. The 5% by 8% laminated cards 
are easy to follow and convenient to 
carry or store. The reading level for 
coimercial or teacher^made resources is 
0*4 chough many of the activities can 
be used with 5^8 level students as well# 



A STUDENT^ORIENTED CURRICULUM 
A s tudent^caacher survey which catagor- 
i^ed 100 life skills casks under five 
APL areas was read to BASIC (0-4) 
students and they ware asked to rank 
from most needed to lease needed the 
ten skills they wished to acquire. 
Teachers indicated the skills they 
believed their students needed. These 
two lists were rainarkably similari and 
served as the basis for the 100 lesson 
plans . 

TEACHER CARDS AND GUIDE 
Each of the 100 teachers cards is 
directed toward a specific competency 
in one of the five APL areas. Each area 
is a self-contained unit with 20 lesson 
plans which tend to build on one 
another's information. Each card con- 
tains the following informationi A) A 
number/letter keyed to a Participant 
Life Skills Checklist; B) estimated 
classroom teaching time ; C) the APL 
areai D) specific life skills topic 
(ie* Your Pay Check), and E) the lesson 
plan. 



FOOJS ^ euCTirolM is a Adult Education 310 Curriculum Development Project « However, the opinigns 
expressed herein do nob neeeesarily reflect the position or policy of the Penniylyania Oepartment of 
education or the U«S, Department of Educatipn, and no official endoraement should be inferredi 



^ch lesson plm includes suggestions 
for 1) teacher preparationi 2) basic 
skills to be raster^ ? 3} specific 
aetivitiea* In addition , each card 
provides a Dmonstoation of tonpetence 
and an Individ nai Life Skill Activity 
that suggaste ways in ^rtiich the skill 
niay be us^ in daily life. Thm 
Teachers' Gjida des^dtes tha gaming 
tectad^guas umed and inriudes biblio- 
graphic of audiQ-visual and 0-4 level 
COTnercial reading inat^lals, 

PffllHi RA^mi^i Remaking ^^mt "the 
activities grMt^ and the cMds 

clear as far as basic skills Me 
concerni^?" the panel rat^ the 
ijmova^on superior pluSr the effect-^ 
Iveness staperior, and the adaptabili^ 
excellMit, Scoa (»nc^n vmrn ^^ress^ 
that snail ABE p rograsre ndght not have 
SOTe of the books or ecpipnent called 
for in the lesscoi plmis. 

FOCUS miTOR BASIC SFTTJ.g 

laiiEnja^ Acts foe Bei^jinMS f FY' 83, 

ms DETODOPH) TO iRoyms Tm te^j^er 

USING BMIC SKTTT.S MADE EASY POTH 
<3A^ESf ^^BD LISTS/ PUZlLffi AND Wm 
PLftY SITOATIOT^r ETC. CMZSm FOR m 
Tm I^SON PLANS, 

PROJECT READ 

peve loped byi Miry Catherine Spenee^ CIU 10 Dev^ 
eispment Center for Adults, Pleasent Gap, PA* 

Fundad at $7^102 and cpmpletad Septam^ 
bar 25, 1984^ PROJECT READ providai 
three workbooka with aecDmpanylng 
tapes and language master carda far 
adult atudents at 1^3 raading lavel. 
It features a eontrollad vocabulary 
taught in a seope and aequenee of 
phonetie akllla and built upon aubjecc 
mattar of prima intarast to the 
students thamselves. A tall ordarl 

WIUT DO STUDENTS WANT TO READ ABOUT 
One of tha intarasting and most trans^ 
ferabla parts of the projaet was the 
raader interest survey eonduetad by 
lUlO* Projaet staff detemined that, 
at laast in their pleasant valley 



adjacent co Pann States adulc learnars 
wane Co read about love scories, wed*- 
ditifs, TV shows, cooking, romance, 
hisCoryt huntingy fishings and sports. 
As part of the survay, students were 
asked CO identify the activities that 
helped tham read better and the 
activities they enjoyed tha most. 

TEACHERS ' GUIDE i A BONUS FOR TUTORS 
The Teachers' Guide is written so 
clearly and the ^nqks so easy to 
follow that ba^-^^i% tutors and 
teachers will f^^ ix an excellent 
resource, We par^s^i^xarly liked the 
Annotated Bibliography at the end of 
Book 1 listing gsublishers' 0-4 level 
materials. It compilied from ABE 

teacher reconnnendations as reviewed 
by project staff. 

PANEL BATINGi ^^ile concerned with 
the cost of duplicating the entire 
package, the panel rated the project 
superior in innovation and effective^ 
ness* They were particularly impressed 
wich the possibility of se lf--direc ted 
study at this lowest level, and the 
assessment of student interests* One 
panelist suggested that because of its 
slaw^-paced sequential format, it might 
serve as a model for a computer 
literacy program. 

***♦♦»♦ 

CONSUMER MATH CURRICULUM 
FOR THE 0^ ABE STUDENT 

Dgvaloped bvi Dr. Rabert Zellers, Education 
Division^ University of Pittsburgh at Johnstown 
Johnetown, PA 15904, 

In the push for literacy, we sometimes 
forget that basic skills at the 0^ 
level must include math as well as 
reading. Too often ABE beginning math 
tests are children's books with 
different covers* Consumer Math offers 
an alternative * 

A RESEARCH APPROACH 

This project began with a research 
component j includifigf 1) an assessment 
and and analysis of 0--4 math materials 
available! 2) a dateirriinat ion of eric— 
aria based on national standards and 
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theorecical norms | 3) a field tesc of 
Che aaaesment wich adulc sCudencsf and 
4) a survey of ABE students and GED 
graduates as to their needs and 
concerns in relation to eonsumer math. 
Their interest in eheck writing is 
evident in the curriculum paeket, 

KIT COMPONENTS 

The curriculum was produced as a kit 
which includes printed and taped 
material* Within limits ^ this fomat 
permics usage at different ability 
levels individually or as a group* The 
taped segment introduces the concept 
of consumer math and contains the pre 
and post assessmenC* Five packets 
contain colors-coded laminated instruc- 
tional cards* A Teachers' Guide offers 
suggestions for alternative activities 
the text of the tapes ^ a supply of an- 
swer sheets^ and a key to the tests* 

PAHEL EATINGS Judged superior in 
innovation and effectiveness and good 
in adoptability, the panel spoke 
highly of its ease of use and its neat 
packaging. "A most practical product!" 
One Caution; It might be wise to 
rerecord the tape as the speaker's 
voice is fast and sometimes garbled* 
******* ♦♦#**** 

CURRICULUM W EMPLOYMENT 
A 0-4 Lemming Prep^ti for 
Unennployabla Women 

Devai^prt . tiy t Azi Ellanriteh and Kathy Reiilyi 
Carol Goertiei, preject direeter. Lutheran 
Settlement House Weman's Progranij 10 Ea^t 
Oxford Street, Fhiladelphia, PA 19125* 

This projecCy the third in a series 
by the Lucharan Settlement House 
Women ' s FrDgram, puts Paulo Friere ' s 
principles of learner^centered eduea- 
tion into praeciee in Philadelphia, 
FA- The eurrieulum created is a pro- 
duct of the interaction of adult 
students, the curriculum developer, 
Philadephia businesses and their 
employees, and the ataff of PDE's 
Division of Adult Basic Education. 
It uses the principles of active 
listening and codification [finding 
themes in pictures and stories] as 



EKLC 



the foundation for vocabulary develop- 
ment, reading comprehension and analy- 
tical skills which can be used by the 
adult itudenta in their daily lives. 

Funded at $14,683 and completed August 
30, 1983, the 95-page booklet with 
stories and photos by adult students 
speaks best in its own words i 

•*TitY NEVER ^€W I COULW*T RM" 



A Blifid aa 
Taught ib i 
To ranquer 
The EL. 

"Hopf ewi you 
T*B thm EL?" 
He said that 



The EL 

Zm't 13Jm a tim 
^^mt mta^ 
With traffic. 
Tlie a 

gpra straight 
to the nsKt 
stop* 



Sa^ you sswt 
the et^^* 
That imf 
you fomt ^^hmn 

to get off. 

The above selection is ineluded in the 
theme segment, Solutions p Other 
se^ents include: Working Condicions, 
Women and the World of Work^ Non^ 
Traditional Work^ and Doing it ALL 
Work J Home, and Self* 

THEQRY AND BfflTHODS 

The first 30 pages of the booklet 
deeribes how the eurrieulum came about | 
presents in student words and staff 
observations a sensitive insight into 
what it means to be an adult non^ 
readerf and details the teaching 
approach including methods and 
attitude favored by the project staff* 

FAKEL RATZHGi Superior in all respentSf 
the panel noted that the product Vas 
very clearly princed and easy to 
duplicate I very innovative and 
sensitive to the needs of unemployable 
women, and above all^ the language 
activities provoked interest and 
discussion as well as basic education. 
This curriculum tells it like it is, 
and asks adult non-readers not 
teachers i How do you think it should 
be! You need a teacher/ tutor secure 
enough to handle that* 
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PROJECT LEARN^MAN 

Oeve loped byi Nancy Fggelmanv CIU 10 Develooment 
Center for Adults- Centre County Vo^Tech 
ScheolSt Pleasant Gap» PA 1iB23, 

How do you Cum on ceanagers and young 
adults to Math and Graisaar? With great 
difficulEy might ba ona answar. With 
Pop Music is anothar* FrojecE LEARN- 
HAN providas a uniqua delivary system 
LOT salf— inscrueCion which faaturas a 
Pop 40s format acGompanying a sequant- 
ial prasanEation of 26 Math and 
GraimQar las sons- 

Tha project, funded at 513,355 and 
complacad August 1983, ceamad a radio 
disc jockey and an adulc adueation 
taaehar Co produce 13 tapas and a 
workbook with 26 ralatad lassons* The 
and rasulti not only looks profassonal 
but young adults in tha piloc study 
showad a 50.5% gain batwaen pra^ 
and post-test seoras* 

WITH A LITTLE HELP FROM MY FRIENDS 

Tha Beatles* John Denver, Linda 
Ronstadt and Billy Joel are a faw of 
tha 'friends* who eontribuced to 
making this curriculum a truly 
exciting learning expariance. The 
scripts, which are printed in tha 
final report, include such commants 
as : 

This l^san is on helping verbs * I auggsst 
you listm to the tape on verte before 
trying this one. Notice hm Billy Jo#l lms 



the word "can^ in this eong. Listen care* 
fully to the verbs tt^t follow the word 
"can" in She's Always _a Wgom. 

Cm im arm of iwiy helpir^ verbs. The words 
following the word "cm" in every case are 
verbs. For exnplet Qm% kill, can w^gg , mm% 
r"in ^ can lert onf ^ on. 

[AND SO ON, J 

FAMEIm bating I One of tha many fine 
literacy projects reviewed, LEARN- 
MAN*s list of credits include: High 
Intarast for one of tha hardest to moti- 
vate audiencasi the young adult; 
professional , attractive , easy--to-^use 
packagingi super entertainment for the 
dullest of instructional, areas* 

It was felt that this project could 
help to individualise classes to soma 
extant as well as provide instruct- 
ion in areas likely to be intimidating 
to young adults studying in a home- 
bound tutorial situation* 

Soma concern was voiced as to how long 
it will remain current, as punk 
rock and breaking replace solid 40s 
Pop, Also, the speaker on the tape is 
vary "straight," with little humor. 

Despite these few failings, LEARN- 
MAN was ratad Excellent ALL THE WAY, 
or, perhaps the best way to describe 
it would be I UPBEAT! 

ADVANCE ADDRESS: 11* Floor, PDE, 
333 Market St,^ Harrisburg, PA 17108, 



FOCUS ON CURRICDI.roi IS A 310 ADULT IDUCATION SPECIAL FROJECT FUNDED BY 
PDE, DIV. ADULT It CONTINUING EDUCATION^ DR. JOHN CHHISTOPHEH, CHIEF. 
THE REVIEW PANEL MODERATED BY FOCUS EDITOR, SHERRY ROYCE, INCLUDED: DON 
BENDER^ PDE CORRECTIONM. EDUCATION i LINDA CARL, CATHOLIC SOCIAL 
SERVICES ESL COORDINATOR? JOAN LEOPOLD, ADULT EDUCATION H^RiSBURG 
STATE HOSPITAL J MJNETTE MCALLISTER, PA CLEARINGHOUSE ADVANCE; AND 
GERALD VALERI, FEDERAL PROGRAMS ALTOONA SCHOOL DISTRICT, 



A me - Ffpjwt 
1^8 Cnski^ Drive 
LsiMter, PA %7im 



Biilk Rate 
tl.S, Faata^ 
PAID 
Pen^t No. 8M 
LaisMtert PA 17fiC»l 



erJc 
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A LONGITUDINAL STUDY OF ADULT BASIC 
muCATION IK ViHGINIA, 1970-1985 



This lomgieudiaal study was funded as a 310 Sp^ial FrsjMt by thm 
7irgiaia ita£a Dapartoeat of Wueatiom, Adult Idueatioa ier^rica* Thm 
purpQsa of thm project was to dOTclgp and isplraeat a stacawide avaluatioa 
of thm Adult laaic Education Frogrm* Thm evaluation eMoapassad thm stati 
and local Igrels of progrM delivery md studied thm stata staff, local 
administrators, superrisars, taachers, counselors » aidas, and itudaats^ 

In 1970-71 Virginia Coamonwaalth Univarsicy conductad thm first 
Tiriinia stata-wida ASE aTaluation and in 1977-7 8 conduotad thm sacond 
avaluation. ^asa avaluations wara oitad by E*I.W, as outstanding studies 
and wara usad as the modal for several othar statawida evaluations. It is 
important to nota that ona-time dascriptiva studies are valuable, but 
comparative studies ovar a paried of time which indicate change and growth 
ara more dasirabla* Siaca Virginia Comonwealth Univarsity conducted the 
original and sacoad study it was ia the best positioa to aaasure changes 
that have o.^currad siaca the first aad sacoad avaluatioas, Furthermora, 
many of the original data gatheriag instrroants could be used again whara 
appropriatat thus accruing considerabla savings ia the avaluation design. 

raa evaluation covered the entire AlE program at both the state and 
local levels and iaeludes a repraseatativa smple q£ urban and rural 
programs as well as the variety of students served by the local progrimsp 
All factors bearing on the efficiency and af f ectivaness of the program were 
considered. 
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jpe^ifie Design 

e'^aluaciom desiga aad impl^memEaCisn prQ€edur€i will be diseuaaed 
in th^s mrnQtion. 

P^Q iae_fe_Ob ieejfc_fae§ 

The felloirinf objeetiT^s w«e idemtified and appro'^md fsr the 
stacavide c^mluatiasi 

1# Tq appolnc a statewide ABE E'^aluatioa AdTisoiy Committee to 

ad'^'iaa and assist in the identifieaCiQn sf appropriate e'^aluatiQQ 

data sourees and taebaiques. 
2* To design and implCTent a statewide progrm evaluation Co be 

oonduated during the sahool year of 1 984-85 • 
3« To oonduot a representative statewide assessment of eaoh sahool 

district's ^1 students utilising an appropriate instrument to 

be identified bj the projeet and the Advisory Comiittee. 
4* X© OCTputer Malyse the statewide data oolleeted with 

appropriate statistical tests* 
S- To eompare the results of the ourrent study with the results p 

oonclusions and reeosmiendations of the two previous studies » 
6. To prepare a comprehensive evaluation report on all phases of 

AlE program operation^ 
7 9 To dissMiinate the evaluation findings and reoo^eadatioaa in 

the form of a printed report and to su^nariEe and discuss the 

findings at appropriate meetings, e-g.i Dissemination Conferenoe 

1 984-85 • 



50 

-47- 



ERIC 



AdmiaistratiQn 

The prejeGt was coadueted by the Adult Edueacioa Progrmm q£ the 
Division of IdueatisBal Studies, Virgisia Ooimonwealth Hni-y^r'sity (TOT). 
l>Tm Ronald She«em was Che pMjeet dii^eefior. 

frQeedures 

Evaluation Design, the basis evaluation model utilized was Stake 'i. This 
modal has been successfully utilized for study of various eduoation 
proframs and is recognised as one of the most appropriate for studies of 
this type. The evaluation will be primarily suamative* 

It is espeeially appropriate to not only present a pieture of the 
eurrent status of -^1 profr^s^ but to present oomparative data froa the 
first and second ABl evaluation reports to ii^isate growth longitudinally 
and lonf-ranga trends*. This was a unique advantage of the ?CT project* 

LQcmtiong. Richmond and each participating progrm and all Adult 

Learninf Centars were included. Travel was made to local sites based on 
requests for assistance and the obvious need for data collection as 
evidenced by slow or no returos from certain school divisions. This will 
probably involve a mininmis of four trips. Based on past evaluations data 
trips will probably have to he scheduled for the Norfolk area* the 
Washington areSi and several rural divisions. 

The specific locations were projected during the first quarter 
planning phase and was guided by requests for assistance and obvious 
trouble spots* The r^ainder of the travel was determined as the project 
progresses. 

-48 — 

51 

o 

ERIC 



gartieieatiQn. T^le 1 iadieaCM the popylaciong studied aad whether Ch© 
data was ^ollaeted fr©m the total populatiom qv a representative ample. A 
random mmplm of 251 af the teaehers 150 niaiiSMi was seleeted. All of 
the All Superrisers were aeleeted and 50% of the aides were smpled. The 
sample was drawn from a random ais^er table from currently enrolled 
students and ^sployed persomel in eaeh sehool diviaion. 



Table 1^ PoTsulationa . greuas. and gassl^a 



f opulation description 



1« State Separteant larsonnel 

2# Looai All Superriaors 

3* Learning Canter Coordinators 

4. ^1 Teaohars 

5* All Counselors 

6 m 1 ara^frofessional 

7m All Students 



Sample Size 



All 
All 
All 

25% Random Sample 
(or 150 minisnm) 

All 

501 Eandom Sample 
10% Eandom Sample 



Hethoda and Mat^riala 

Stake's model was utilized to oonduot the evaluation* All prooedures 
and iastrtments were approved and revised by the Ivaluation Advisory 
CoMiittee and were basieally the instrraents used in the past two 
evaluations. 

In order to ^©llaat the data speoified from the populations 
identified in Table 1, the same instnuaents used in the 1970 study were 

............52,..,.. . 
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updated and revised by th^ Ivaluation Advija^ CowmtttmBm The iastruaeacs 
used iaeluded questiQanai^aSi iaCferviaw guidas, da£a eheek sheeCj, and data 
SOTmary sheets o£ various types for eaeh pepulatiQa studied, 

PMsomal iscarriews were aemdueted with all a^^ers of the State 
staff* and written response to the 1978 Evaluatign aeeoOTeadatiaas were 
obtained. 

Data Calleetiag 

The data was collected using the revised a^ updated instrumeati* 
The evaluatios director * e^aluatioa staffs state and loeal level ^1 
adaiaistrators s sape^isarSi teaohersj esuaselori, aides « and itudents 
partieipated ia the data ealleotion prooedures* ^e loeal ABE supervisors 
and teaohers were respoaaible for dissemination and eolleetioa of looal 
prograa Soimmm 

Data froeegsing 

411 dafia eolleetioa iastruaeats were designed for coaputer processing 
aad analysis* All the data treatments were coapleted with exist iag 
coaputer programs and with special prograas written by university data 
processing staff* The University *s Institute of itatistics advised the 
project director coacerniag proper statistical treataeata^ 

The raw data was keypunched and verified on magnetic tape ia aa 
80-coliam card format for processing by the University Computer Center, 



53 



July Ip 1984 
July^^gust 

March— Apiril 



Frojeet fumded 

AppQimft Ad^tmoTY Co^mLtzmm 

Prepare ialeial design 
IdmmtiMy and hire personnel 

laid first AdvisQiy Meeting 
Approve design and instnmencs 
Identify Sasple 
Submit first quarterly report 

Candnat lurvey and oolleat data 
Visit sites as neeasamry 
iubmit seoosd quarterly report 

Analyse data 
S^mariEe results 

Prepare Evaluation Report 
Submit third quarterly report 

Print report 

Submit final projeet report 
Disseminate report 



SU££ 

This project was oosduated with the esistimg staff of the Adult 
Iducation Program and the folloving Perionnel: 

Keseareh Assooiate CI) Balf««time 
Clerk T^ist (1) lalf-tme 
Computer Prograsmner (1) 5 days 



Svaluat ion Advisers Co^ittee 

Appointment 1. The Ivaluation Advisoiy Comictge was appointed by the 
Projeet Direotor. The Assooiate Bireotor for Adult Eduoation reoomeaded 
mMbers to represent the state offioe and loeal progr^s. 
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ComaLttmrn Rgp^esMtation, The followimg typmm q£ memberi eomstituced thm 

l^Eluatioa Advisory Commltteei 

Dwm Rsmald H. BhmTTQn^ Chmiwrnmn 7CU (1) 

Eeseareb AaslstasC VOT (1) 

i£ace Bepareaaac Km^wmmmut^^twm S^ata D#pc, (1) 

Reglpnal tMfTmBmntmtiwm Btmtm Dapt* (1) 

Adaiaistrator Cl*liL), Cl-^E)| Cl-IiRC) Leeal Fyafrsn (3) 
Teacher (l-TOral)p (l-nirtaa) » C1-I0L) L©cal FrogrM (3) 

itudeat (l-ruraDt Cl-ttrtaa) Loeal Fraerm f2) 

Total H^^ers 12 

Algeruce m^^ers V€re appaiated ia cirder £q eaiure adequase participatioa 

aad repregaatacioa whea meeclmfs are held^ 

Comalttee Hespaaaibilltiea* Thm CamitSee will aperaCe oa a demaQraeia 
basis with sajoriey rule oa iaaues requiriag a vate. The members will be 
^peated tot 

Im Advise the project ta iastrimeat desiga* 

2* Determiae appropriateaeia a£ icbedullag* 

3. Select factors to iaclude ia a^aluatiaa. 

4* Select criteria aad staadards for judflag results • 

5 m Eaco^sead a^ialstraclTe aad dlssemlaation pracadures. 

6m Ferform other duties as apprapriate. 

Heating Schedule^ Vpaa appaiatmeat» the Chainaa will call a plaaalag 
aeetiag prior to the fiaal evaluacioa dasiga. The CoBmiittee will meet a 
mia^um of three times mad mare if aeaassary. TOe aecoad meeciag will be 
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upon aCTpl€tiom of thm dmCm GOIlMtlom phmmmm Tbe fiQal meeCing will be 
hmld prior Co thm priaCiag aad diasaminmCloa phase. 

QoQTdtnmtLmn and Digsemiaatien 

Close liaisioa was maiataiaed with thm Adult IdueaCioa state staff 
mad a repreaeatati^e of the state staff was iacluded oa the E^aluatloa 
Advisor^r C^mittee# 411 pwooedures aad iastrMiaacs were lubmitted for 
approval to the Ad'^lsory Comittea sad to the State Departeeat, Crueial 
oorrespoadeace aad other ooramialoatloas with the looal progrms were routed 
thraygh the appropriate State Departoeat Area iuper^iaors. 

foraatiire reports ideatif7iag i^aediate fiadlags aad reeo^eadatioas 
were made as reialts were oompleted» The fiaal st^siaCiTe report will be 
iubmitted to the State Departteat of Sduoatioa with luff iaieat copies for 
all participatiag loaal progrmsj the f artioipatory flaaaiag Comitteej aad 
other coaeened parties* 

Fiaal Report. Copies of the fiaal report iaoludiag all results aad 
reaomeadatlQas for program usprorsieat will be delivered to the State 
Adult Iduaatioa ier^iee. The Adult Idueatioa Service will dissemiaate the 
copies to appropriate state aad looal supervisors « 

Additioaal diisraiaatioa will be made at the smmer SAQ Coafereace 
aad through the ABE Newg letter, la order to facilitate dissemiaatioa of 
the total report a -^'"T"frT Report that highlights the results aad key 
reaosmeadatioas will also be prepared. 
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Adult VrnTfommnam Le^el C^^Ii) BuT^m^_ 

AIL Bii-nmw sheuld be iseorporated inc© thm regular Ceiting proeedui'as 
a£ thm IBl progrm* Imtry aad uit arapetanay lavela should ba measured. 
Reading tha aacioaal aaaa score 2i>16 absuld be made a acaCewide g@al« 

Ree emend ac ion 

All aQSteat: areas reported in the AJIj Sur^e^ luggesC Cbe need for 
statewide attention^ This ia slearlj the oase when student performance is 
oompared to macional norma* ABE curriculw plowing should be based on the 
Adult Perfonanoe Leirel Goals and Objectives. These goals and objeoti'^'es 
are the oriteria of fuaotional competenoy. Level of functional competeaoy 
is measured by the AgL iurveT * Use of the goals and objectives for program 
plamning should be coupled with on-going use of the AFL_Su^Les: * Use of the 
goals and objectives for progrm planning should be coupled with ongoing 
use of the AffL Survey for statewide evaluatiom. 

Action Tmhen t A decision was made not to adopt the APL format but racher 
to incorporate the AiL competencies into asisting ABl 
curriculum format. 
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LQeal In^Serviee Training Frioriciaa 

Aa previeusly discussed ia the aeate la^el secfeisa and ia thm 1970 
report j a eompreheasi'^^e ia-saxiriee traiaiaf plma should be developed tfaa£ 
utilizes a variety of traiaiag desigaa* Too mueh aphasia aad relimaoa is 
beiai placed ©a oae-shots oae^ aad tvo*4ay workshopa. The traiaiag offered 
should have ooatiauity aad a logical progressioa, e*g*, new teachers and 
staff should be given Adult Laaraiag Gharacteristica first* Curricula 
Daaiga aad laatructioaal itrategies second. Student Ivaluatioa third, etc, 
niB 309 projects should logically complOTeat each other aad offer a variety 
of traiaiag opticas g i*e.t courses ^ indepeadent study ^ small group 
semiaarss weekead retreats * coafereaces, workshops ^ etc, 

la additioa to state level fuaded activities , each Local progrm 
should plan and implCTent ia-service activities for the staff at least once 
a quarter and preferably one day a month* Staff who attend regicaal or 
statewide traiainf activities should share the new knowledge, coateat and 
handouts at a subsequeat local ia-service seas ion* lacfa local program 
should allocate fuads for local traiaiag activities. 

Action Takea; A traiaiag desiga lacludes locMl, cluster training, si^mier 
iaatitutesg aad regioaal supervisory training. 
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Proaeduyeg fog Bmzzxnm 310 Funding PglQ^ieleg 

'nim 310 fumding procedures now include inpue from m sc^eewide AlE 
Pmrtiaipator^ Flmnning Qom^Lttmm (FFO)* The state itaff and Cha PFC i€£ 
the aasual 310 funding prioificies wlch da^a from pre^ioua needa asses s^^ 
a@nt3» loeal progrra reports and matiomal data compiled by thm Adult 
Eduemtion AdTlsary Counell. All of the prioricles are certainly addressing 
progr^ needs and areas of oonaerm. It Is still not clear if the 
priorities are ranked in any manner Chat will provide for attending to the 
most important first. 
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Aaother area of eoneern is the e^alumties of pr©poaals for fuading, 
Se^atal «amplei hava oeeurred whare thm ageney or ioseicutions funded were 
unabla eo aemplatt thm proj@e£ satisf aetorily . 

Rae omeadat i oa— B tac e 

Periodic nmmdm assassaanga should he ooaduoted to datarsiae 310 
priorities. Data should be obtaiaad from staCe itaff , fFC, local prograost 
iastitutioa of higher eduoa^ioa, Hatioaal Advisory Couacil, aad the profes- 
sioaal literature ia adult edueatioa* The priorities should be ranked and 
ooaeiaued uatil data iadieate the problea has been solved or the need met* 
Friorities should be earefully screened to deteraiae if another itate has 
already studied or solired the problCT. Nraerous asamplas «ist of several 
states solving the s^e problCT* la many oases the solution oould ba 
shared and implemeatad with slight or no modif ioatioas. 

Monitori ng Frooedureg far 310 Funding 

It is elear that adequate moaicoriag of the 310 projaets has not 
ooGurrad* la some oases of iaadequate projeot performanoe it is doubtful 
if additional monitoring would have helped. It would; however, have 
ideatified uasatisf aetory performaaca before the end of the project. 

Rag ommeada t i on****S t a t e 

Criteria should be developed for ranking proposals and detarminiag 
the ability and aapaoity of the grantee to esaduot the proposed projaet, 
Moaitoriag should be ooaduoced on a pariodio basis by an objaotive party. 
It is a difficult or impossible role to be an advooata, e,g*i teohnioal 
assistant and a monitor avaluator at the sraa time* Perhaps the staff 
should monitor as a group, and individual suparvisors should aonitor 
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projaets oeher than those ifl thair area, fart of this problm Btm^B frea 
laek ©f staff, thus reiaf oreiag the prs^ious reeoimeadatiom for adequate 
supewisory staff. 



State Le^^l Canceraa 

Each m«her Qf the State staff was imta^iewed aad given the 
□pportuaity to diseuss various progrm eoaeeras. This section will report 
the topics discuaaed* 

Funding. Inflation^ inadequate fundings and the aubsaquent loss of a 
aupervisorjr position all ^phasi^e the contiaued funding problem* All 
m^ers of the itaff feel that the program auffera from lack of funds. The 
state provides only the mintsum required 10% iMtching for the federal 
funds* This indicates little aupport for the ^1 program and concern for 
Tirgiaia's approxisatelj 1*08 million illiterate adults. 

Ii_e4d#fah^p* The staff expressed concern about the araeroua adainiatrative 
changes over the past years and a need for additional leadership and more 
focused progr^Mtic goals. Niaieroug Maples were cited indicating poor 
conarunication within and between services and departmaats* 

fi^ld Sup^^iaien* Coacern was expressed over lack of time to adequately 
monitor prpgrsns and 310 projects. 

Ia!^S€CTice Tralnigg. Staff felt SAIL was good for new teachers but not 
very good for experieaced teachers* Moat felt that the regional traiaiag 
workshops had reached more teachers in specif Ically needed program areas. 
The need for a long-range coordinated ia-se«^ice training plan was 
expresaed. 
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Aa interssting poiat was made by tVQ itaff makers eoneerniag 
ia-sar^ie© feraiaiai for the State staff in regard to aertaia types of 
tMhaieal asaiitaace and project monitoring. It appears that the itaff 
would like to wmamLwrn some ia-serriee traiaing as well as provide it for 
looal programs* 

D#adlineg, Coneerns ware iadioated about various deadlines aot being met 
or lateness ia diisfflinatioa of guideliaass reports ^ ete, 

I^aaEL* la feaeral* the state sup^CTisery staff is Tery oonoeraad over 
the laok of admniacrative support aad iMdequata fuadiag to properly 
supervise local proframs aad 310 projects* Morale is fairly low, but all 
are optiaistio aoaoerniat iacreased fundiag from the state aad/ or the 
federal grant* fending organizational aad administrative changes may 
alleviate the pr©bl«* Table 5, 42, shows the peroentages of iupervi^ 
sory time devoted to various All program activities, iacluding monitoriag 
aad giving t^haical assistaaee to ABl 310 projects throughout the, state. 

The Associate Director's ^1 progrra activities have rraained 
basically unchanged* The one sigaificaat chaage noted was a two percent 
chaage ia la-service traiaing activities* Historical ly this function had 
been primarily conducted by the supervisors. 

The major changes here occurred among the ABE supervisors in their 
allocatioa of time aad aonsultatioa from local supervision to progrm 
plaaaiag* tte southeastern aad northern area supervisors have approxi* 
aately tripled their perceatage of tme spent on program planaiag while thi 
southwestern area supervisor has iacreased his time by only one-third. 

The largest change has occurred in the area of in-service training 
with a 1401 iacrease ia time allocated to this activity* The second 
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Tflbli 5. Pgrcintsgi of Totil Professionai Staff Time Allocflted to ABE Prograni Activitiei 



ABSociate Director ABE Supervisor 
Adult Education Richmond Office 



ABE Supervisor 
giclioiond Office 







Richnond Office 


R^li^llPSfl^@f n DFflrs 


__iiyrL!iErii 






X 


% 




local Supervieion 


19?8 


2 


25 


35 


h GonsultatiDn* 


1985 


2 


10 


10 




Change 


0 


-15 


4 J 


ProgriDi 


1978 


20 


15 


10 


Planning* 


1985 


20 


40 


35 




Ohflngi 


0 
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PrograiR 


1978 


5 


10 


10 


Profiiotion* 


1985 


5 


10 


5 




Ohsflgg 


n 

V 


u 


■5 


Gurriculun 


1978 


5 


e 


15 


Divelopnent* 


1985 




0 


0 






-1 


-A 

0 




HaterialB 1 


1978 


5 


7 


7 


Eqiiipaitnt 


1985 




0 


0 


Selection* 


Change 


-1 


-7 


/ 


In-gervici 


1978 


0 


10 


5 

15 


Training* 


1985 


2 


20 




Change 


+2 
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j.1n 
+IU 


ProiriB 


1978 


8 


5 


3 

15 


Evaluation* 


1985 


8 


10 




Change 


0 




Hi 
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1978 


15 


5 


I 


Correspondence* 


1983 


15 


5 


10 




Change 


0 


n 
u 
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Ron ADE Prograni 


1978 




15 


10 


Activities* 


1983 


40 


5 


10 




Change 


0 


•10 


0 



ABE iupirviior Averap I 
Abin|don Office of Tiii 
SguthweBt ern 



X 



35 
40 

+5 

10 
15 
♦5 

10 
5 

-5 

10 
5 

-5 



-2 

5 
7 

+2 

S 
8 
0 

5 

10 
♦5 

10 
5 

-5 



lage 

Allocated Chanee 



24 
16 



13 
27 



16 



8 

12 



6 

12 



5 

12 



6 

10 



11 

10 



19 
15 



-331? 



♦1071 



+1001 



+501 



+1001 



+1401 



+661 



■91 



-211' 



Uvimst change is in the area of program planning » with this area shewing 
33% wcreaae. Local auperviaioa and eonsultattioa showed a 331 decrease. 

It would appear from the ehanges indicated in Table S thaC since th# 
reduction in staff and the addition of and increases in adainiscrative 
requir^ents, e.g., program planning, reporting, monitoring, etc., local 
programs are not receiving adequate field supe^ision and technical 
consaltaeion froa the State staff. 
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Staff Training 

Sinea thm 1970 study, a great ^mtiaty of ia-se^iee Craiaiaf 
opportuaities have been prOTided by bstb 310 prejaet fumdimg and c@ursa 
offeriags by itate eall#gss aad ualvgraltiga* Table IS susm&vimmB thm ABE 
taaehe^s- aad supervisors' ratiags ©£ tbe ia-serriee Maiaing aetiTicies* 

T^la 18* Stamarr of la-gerv^ge Traiai ng Proerm Ratings 

' Sigmifiaaa^a 



later Eating Pereentage Differenge of 
= IWO 1978 1985 1970^85 Differenea 

ASl Suparrisors Adaquata 2f.6 46.7 73*4 443.1 >*01 

Set Sure 12*2 13 ,3 13.9 H.7 HS 

laadaquate 58.2 40.0 12.7 *4S.5 >*01 

TOTALi 100.0 100.0 100.0 

^1 Taaahers Adequata 3S.S 37.7 fiO.l +24*6 >*01 

Not Sure li.9 18.0 12#7 -4.2 NS 

laadaquate 47.6 44.3 27*2 -20.4 >.01 

TOTALS 100.0 100.0 100.0 



Ovarall the teachers - and super^iaors ' ratiagg of tha ia-»sarviee traiaiag 
progr^flS are dramatically iaeraaiiag. Some 73.41 of the suparrisors aad 
60 .IX of the teaehars rate the iu'^sar^ioe traiaiag prograas as 
"adequate." Over the past fifteen years the i^E superriaors ' ia-sarviee 
traiaiag ratings of "adaquate" have risen from 29*i% £o 73.41* The 
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tmrnahBTB* raeimgs ©f "mdequaee" hav© Timmn from 35*S% Both of 

these iaereaa^s m,Tm sifnifieaat beyond .01 le^el. These iaereasea 
indicate £ha£ the state staff and leeal supei^isoi's and teachers ha^e 
signif ieantly isp^wad their In-ser^iee training proirms* Bamm 12,7% of 
the siiperrisors and aver Qne-fourth (27*2%) af the teachers rate the 
in-service training profrms as "inadequate," 

table 19 indicates participation in various types of in-service 
training. All tnpe^isors » participation local wrkahops has remained 
fairly constant over the IS-year period* Their greatest increase, ^9.6 
percentage points, was in the area of Regiomal lastitutes and Workshops. 
College Credit Courses showed the second highest, 4^31*2 percentage points, 
since 1970. 
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Thm ABl tmAChmTM ihowed thm samm cyp©s of iasi^eases with +42. S 
peMentaie paiaCs io "^egigaal" tMiaiag aetivities and +26.0 pergencaga 
points is mQllm%m credit courses. The incramse is eollefe credit egursas 
is direetlj rslated to the availability of adult ©ducatioa eou^sas and 
dagree prograas at e€7»al af the itate'a institutipaa of higher edueation, 

ReaemMdat ion-^i feat b 

More loaal partioipation in eluster trainiag and ragioaal workshops 
should be proffloted. funds should be alloeated from looal progrms to allow 
sore teaohers to partieipate in i^tt and/or other statewide and regional 
trainiag progress. Deliirery systras and paokages for lo^al ia-serrice 
craiaiag should be developed aad ijnplraeated* funds should be allocated 
for required miaimal ler^ls of loeal eraiaing aeti^ities* 

This concludes the presentation ^ discussions amd recejtmandatioue for 
the state level factors* The following section will treat local progrsa 
factors. 
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ieG£ioa will t^sEt iQeal ia-*ser^iea Craiaiag* 

thm iuparviaors and 27*2% of the ceacheri raced thm in-serviee 
C^miiiini program for caa^hers as "insdaquace*^' This Is a significianc 
decrease of 26 perceatage poiaEB siace 1970 ia thm "iaadequate" racing by 
teachers aad super^iiori* TtiLB iadicaces thaCp overall, thm Loeal 
in^sarviae training progrwa have signif ieaacly iffiproved* 

Iq^SM^ Qrieatation * Some 38-2% of the teaehers did not reeaive any 

formal job oriaatatioa upon initial enloymeat« la 1970 soma 34% q£ tha 
teachers indicated that thay had racaivad no fomal job^orientatioa. Dvar 
the IS'^yaar period then has baan no iigaif leant chaaga la iaicial job 
oriaatation« and approKmately one^third still receiva no fsrmal 
oriaatatioa to thm AlE teaching sicuation« 

Rac Qtmaaadat ion— S tate 

An initial Caachar orientation package should ba davalopad and 
distributed to all local progrms. Local suparvigors should hava the 
responsibility for giving this package to each naw ABl taachar. The 
package should lacluda local program data and policias» stace policias and 
guidalinasy adult learner Information^ suggested curricula materials, 
evaluation proceduras and suggestions « recomLaadad instructional sEracegias 
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and machadsi scudeae reaord fDrma&fi aad refarirml ressurees aa a minimum. 
This paakaga should be designed Co bm used individually qt with gi^gups. 

FafgicipaCion in la-aeTyiee Training . As iadiaa£ed in Table 80 an Che 
followimg paget the greaCesC increase hms been ia the perseatage of 
superviBaTS and teaahers who ha'^e aCteaded fDur or more in^servicie 
aetivitiea in thm lasc five years. Only 5*1% of thm supervijors and 12. 7% 
of the teachers iadiaated that they had atteaded ao in^serviee aotivity 
over the past five years. 

la generals the partioipatioa in in^serviaa training aetivitiei has 
sigaif iaantly increased over the past 15 years. On the average, however » 
supervisors aad teaohers attead only one in-*servioe aotivity per year- 

LQcal_In*ierviee Training Priorities 

The loaal cluster traiaiag concept is being implCTented aoross the 
state through 310 project funding. This has greatly inereased the Iseal 
in-service activities. Table SO, on page IJ5, summarises the ABE 
supervisors* raakiags of training priorities. 

Student recruitmeat has maintained its number ane ranking over the 
past 15 years. Curriculum dOTelopmeat and student retention are the only 
two areas that have significantly changed* la geaerali the rankings have 
remained fairly coastaat. 

Student plasmeat and fol low-nip have coasisteatly raaked last in 
in— servioe training needs. This ffiadiag relates very well co the previous 
finding that very little, if any, follow-up activities are conduoced by the 
looal programs. 
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Tabla 80, ABE BupervisorB' and Teacheri' Ciimiilative 
Number of In-Bjgryici Triijiing Seas i one Attended 



gupervjior TeagheE 

Signtficanca Bignificanci 
Farcantaga DiffarenQe of Parcantaga Diffarinoa of 

iBsione 1970 1978 J9B5 1970-85 Differe nce 1970 1978 1985 1970"B5 DiffaranQe 

25.6 58.4 57iO +31.4 >,01 14.5 27,9 52.6 +3*8 >.Dl 

12,2 13,3 13.9 +1.7 MB 9.0 14.3 7.5 -1.5 NS 

23.2 10,0 13,9 -9.3 HB 12.7 13.4 11.5 -1.2 NS 

17.1 13.3 10.1 -7,0 Hi 20.9 19,8 15.0 -5.9 NS ft 

ve 
I 

21 ,9 5.0 5.1 -16.8 >.0I 42.9 24.6 12.7 -30.1 >,01 

100.0 100,0 100.0 100,0 100.0 100,0 
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ThB faet thmn thm raakiagi have ranaiamd fairly CQttgtmat is partially 
attribucabla to Eha part*tma aacure ©f most local programs and Che high 
teacher turaover rates (30-40%) aach year. TOia ereates the aaed to train 
amr teaehers eaah year in cha msmm iapertant areaa, a.g«s atudaac 
rearttitaent* atudeat reteatiang eurrieulm daTelopaanCp program promotion, 
eC€« 

Regjam god ati on— State 

As recomaaded la wo previoas studias, a eompreheasive ia^sarviQe 
traiaiag plan ihould be developed by the State Dapartmeat, A variaty of 
delivary systeBs should be utilizad from iadapendent itudy paokages to 
workshops aad confereaeas. The plan should ba based oa aa up-to^ate needs 
asseasmaat of loaal ia«servioe priorities. There should be a logiQal 
prograasioa of the traiaiag evaats rather than oae*shot crisis traiaing 

Tha aomprehaaaive plaa should ideatify what will be doaa state^-wides 
regioaallys and locally* Local progr^s should hold in-service sessioas at 
least quarterly. Ideally » one day a month should be devoted to in^serviQe 
training. Local programs should allocate allowable funds for local 
traiaiag to oomplemeat the other 310 projects and state-*conduated training 
sessioas . 

Progr^^ Eir^lit^f^-| nrj ^qd Review . ABE supervisors ranked program evaluation 
PMEf* to last in ia^sarvice traiaiag needs. They indicated that 8% of their 
time was allocated to progrm evaluatioa. The supervisors rated the state 
staff *s assistaace ia prograni evaluation from "average to good." This 
rating has not changed over the IS^-year period* la the 1970 study the 
followiag recomendation was made: 
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Frla^itr^ ghould hm gives co davalaping one or sore ins cruc clonal 
models eha£ vill isQQrparaCe cjberaecis evaluatiom faaf:tirei« 

Rgggmendagion^Stafeft 

imsgnctipnal mdal sheuld developed and made available co 
all loQml pTQ^Tmmm The model shoold allcw £01^ concinuous 
^aluatlom» 

The Bt^tm Departmeec ' 3 ABE lupei^isofi and all of the looal ABE 
3uperviao73 should be drained to design and isplenent looal 
evaluation teohniques« Evaluation model 1 and the neeegiary 
inscrmnentation should be developed by the State DeparCTent« 
St^dardized data should be aolleoted on the State level £Tom all 
programi. The data aolleotion p^oaedu^es and instTuaents should be 
designed to implement longitudinal atudieM and to facilitate loeali 
StaCe and Federal reports 1 stuomariei and studies. 

In the 1978 study, a self^study evaluation model was developed and 
dissminated to all local programs. A oritioal feature of the model was 
the feedback from the state-vide evaluation that could be used to 
£acilitai:e local planning and action* The broad goals of the local 
sel£*s€udy were tot 

1. Develop a systOTatic and ongoing process of diagnosing local 
progrM needs that can be responded to with local resources* 

2. Develop, implements and mc^nitor local action plans, 

3* Encourage local progrmis to improve thmselves by their own 
actions and decisions. 

^e Self^Study Evaluation Model was basically a guide co 
self-directed program improvmenc. It is a data-based, problem solving 
model that is intended to establish a series of formative events and 
actions. The self -►study process is a means for each local staff to 
increase the quality and efficiency of its program. 

The following recommendation was made in the 197 8 study 1 

Becgmeada^on 

The Stase Department should encourage each local program co 
engage in a Self^Study using the developed model- The results of Cha 
Statewide Evaluation should be distribuEed and used in each local 



lelf-study. The loeal ABl lupgr^iaor should ha^s thm respQasibility 
foi^ forming and eondu^ting loaml evmlumCion Ee&i^lcieg. Loeml 
programs should ua^ Che modala ia Ehe Svgtmacia laaeruetiQaal Mgdal 
for oriaating and i^rEiaiag its scaffa ia studaat and progrm 
e^mluatiom. 

tt ia nmt suffieieae £o aonduat ABE progm #^aluations every 
sevea years. Frogras evaluatioa should bm a oontlauous maaagement 
tool used by both the state a^ looal level a«taiaistrators for 
decision m^iag. This study iadioates rather elearly that a lot of 
important program decisioas are based oa popular opiaioas and 
admiaiatrative eKpedieaay. There is very little formative avaluatiQa 
feedback oa the looal level and the state level admiaistrative staff 
does not have a aystemacia plan for oonduotiag meaningful research 
and evaluatipa. 

The 309 funding proaedures are being use for oae-ahotj iporadie 
types of researoh and demons trat ions « laoh local program ghould 
budget a portion of their progrm allocation for evaluation 
aotivitiea and the State level staff should plan some long-raage 
cumulative research and evaluation projeots. As emphasised earlier, 
an advisory coimittee would be iwaluabla ia establishing 
longitudinal research priorities and plans. 

There is little evidence to indicate that any systmatic program 
evaluation is being conducted by the state or local ABE staffs. The 
prohl» appears to be the lack of a systematic progrOT plaaniag 
process that iacludes all of the aecessary prograsanatic steps from 
needs assessmaat through progm evaluation. 

RecQTOjgadatioa— S tata 

The State should develop a needs assesameat procesi for local 

use that would also yield aeeds data for state use when sumarized, 

A simple program evaluation design should be disseminated to the 

local programs to collect evaluation data on the following minimum 

factors! facilities, staff, students, instructional materials * 

instructional strategies* This local data eould be summarised and 

used for progrra planning purposes at both ehe state and local 

levels. 
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Conducting sumacive evaluacidns a^ary eighc years can show lQng--ca™ 
ehanga; hew^^M, it is not adequate £©r fonnacive feedback and yearly 
prcgfm plwaing • Again, ccnduacing a meaningful a^aiuaCicn is costly and 
eime-coasiminf , mo thm usual excuse of "lack of funds" preventi most local 
programs from Impl^enting a^ea thm siaplast evaluation designs* 

This concludes the local factors section and the avaluacios report. 
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310 ADMINISTRATION 



There are a number of State administrative activities that facilitate 
or require the use of project evaluations. The 310 Adm inistration 
Self Assessment Guide contains items that relate to evaluation in the 
areas of prforf€y setting^ applications review, 310 guidelines^ 
project monitoring, and dissemination. The Guide, which is itself an 
evaluation instrument, is provided. 

Evaluation of project success is difficult if project specif icationa 
and intended outcomes are not clear from the start. Two examples of 
Requests for Proposals from the Texas 310 program are included for 
your consideration . 
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310 ADlNiaTRATION SELF AaSESSlNT 



mUh SEmSG PHQRITIES 



Does your 310 procss Clrcls Qna i Notsg^ / Remindgrs 

1, Sit ptiorltiis that halp iccoipllsh Not 
the thrsi purpQiai of the Act? Yes Ho sm 



I SsE priorities thit csiply with the M 
landitis of Section 310 of the Act! Yii No lure 



3. Review your State S-year plan 

to asiure that 310 prioritlai will Not 

help achieve State goals? .» Yis No sure 

L Considir conon problens or areas 
of need that an observed during 
iDOnitorlng or evaluation of loeal Not 

I prograig? ,,,,, Yes No eure 

y 

5, Conflldar the riiults of last yeair's Not 
special projects? Yes No sum 

6, Consider the refunding of priorltlis Not 
not mt by previous projacts? Yes No sure 

7, Involve local proirai staff In the Not 
developBiint of priorities? , M Yes No sure 



8i Involvi your Stite association in Not 
identifying 310 priorities? Yis No sure 



9. Analyie the need for both Statewide 

md individual local prograi!! inpact Not 
from 310 projict riiults? i, Yes No guri 
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Doii your 310 procisiMM, Circle One ! Hotel / Ramlndere 



Not 

10, Conilder niultl^yeir prlorltlis,,,,! Yei No sun 

11. Eevlew privioug 310 projects and 
produetii (including thosa froi 

other StiCes) to detetilne if ioia Hot 
are appllcabli to your neidi? . m • . Yii Ho luri 



12, Consider priorltleB that nay be 

best achieved by CGnsortlui arrinii" Hot 
niints with other States? Yei Ho suri 



PHASE III APPLICATION PHOGEBi 



Dofls your 310 prociss, , , , . Circle Qne i 

it Assure that tk flild Is aware of 

your State's purposes for the uii Sot 

of 310 fuQdsftiiiiiiiiiiiii Yfii No iuri 

t Provide technical asilstanca to 

the field in undirstandlng Hot 

currint prioritiis? Yes No suri 

3t Assure that tha proceis is open Not 

and cofflpititiva? Mi , Yes No sum 

I, Consldar using both grants and 

contracts to accoipiish 310 Not 

activities? MM , M No iurf 

3i Allow tha funding of paople 

and organisations not in your Not 

State to conduct pro jecti? ,i MM M. Yea No sura 

i. Mlow the funding of Klnl-|rants?M, Yea No Not 

sure 

7, Asiura a realistic level of 

funding In rilation to project Not 

objectives? M, MM. 1 .mmm,,, Yes No sure 

L Bilgte the mount of funding to 

application requlreiinta (siill Not 

aiDount ^ short application, etc*)?. i Yes No lure 



9. Provide alternatlvi appllcitlon 

riqulreiBents for continuation Not 
pMts? , MiMiM Yis No sure 



Do you publish GUIDEIIIS that, , , , Circle One i 

It Includa a statsnent of your purpoifii Not 

for the uie of 310 fundi? , Yis No, sure 

2i Irisent in ovirviiw of your Not 

310 processi ..MMMMiMit Ysg No sura 

3i Proyldi a dear gtatanent of bicb 

ground, need, and sxpacted outcomes Hot 

for each priority to be funded? Yes No sure 

' 4i Distinguish between Statewide vs. Not 

local iipact intents? Yes No sura 

5. Idintify and give g rationale for Not 
project funding levels? Yes No sure 

6, Oovsr fonaati length, ianageient Not 

j plan requireiQents, ate? ,MMi Yes No sura 

' 7' Distinguish between coipllance 



riporta vs. producta to be Not 

dissiiinatid? ....MMMiiMiii Yes No sure 

8, Provldi ipiclfleations for project Not 
evaluation? , ,.i Yei No sure 

9, Cliirly Identify intindecl content Not 
of products? t Yes No sure 

10, Raquire a project validation Not 

pldn? fiiiffiiiifiiit*il!fFiifMiiM YiS NO sure 
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Notsi / Eeinln dirs 



11, Riquire a projgct disagilnatlon Not 

plSn? ifilfliililllliilfiliiiiiiiiii Y@S NO sure 

12, Spiclfy financial conditions of 

funding (stlpendg, procurenent. Not 

StC i)? iiiiiilliliittiilttiifiiliiii YSS NO SUrS 

13, Identify the criteria to be uied Not 
for propQial eviluatlon? Yes No aura 

U, Outllna the proposal review Not 

procege? mm mim iiiMff •» Ye§ No gure 
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PHASE III; PRMICT HONIfOEIHG 

Dois your 310 proceii Circle Ont i 

1, Make clear Eo project directors Not 
how thiy will be Mnitored? Ygi No iurs 

2, Require quarterly progress riports 

or fonnativi evaluations froii Not 

projects? M M....I Yes No Sun 

3, tbnltor the uii of projict fundi Not 
to iisuri propaii affictlveniss?,,,. Yis No sum 

4, Conduct site vlilti to projicts at Not 
liast twiciyiarly? , Yii No sure 

5, facilitate thi Interietion of your 

projictfl with slMlar 310 projects Not 

1^ in othir Statiil Yei No sure 

L Proirtdi central or regional cleirlni- 

house or resource services for 310 Not 

pvojectsf i.i......M Yes No sure 

7. Provide for the sumitivi evaluitlon Not 

l^cts? I, ,,,, Yes No lure 



8, Provide for a third party (external) 

ivaluatlon of projects that wiH bi Not 
dlisiniinitid throu|hout the Stati?,, Yes No sure 
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PHASE IVj DiaSMHAM m ADOPTION 



If not covired by other funding, dosi 

pwciii Olrcli Oni' 



1, Provide cintral or regionally 

locatad inforaitlon sources for Not 

lodal progrOTs? 1 1 1 « i , , , , , , , , Yis No lurs 

2. iitabllih criteria for 310 Not 
|ict disiiilnatlon?.,,. Yii No sura 



3. Revigw 310 projict outcoiii to 

diteniini if they should bi Not 

dlsifflilnatad? , Yei No sura 

4, Mlow for the funding of adoptioni 

of worthy practices deviloped by Not 

yourj or others etates' 31D projects Yei No sum 

5, Allow for the adoption of 310 or 

other products and proceisas to laat Not 

local program nesds? Yei No sum 

6. Provldi for tha awarenasi of 

teachirs and administrators conc@rn- Not 

ing 310 outcofflis? n,,..,., Yis No sum 

h Provide Impleientitlon workshops, Not 

lad on local niidsf , Yis No sun 



8, Identify thi best iithods of dlsifimi- 

Mtlon (newsiittifs, cliirlnghouies, Not 
intition, etc,}? Yes No sura 
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If not eovirid by oEher funding, 

does your 310 prociss , , , , Circle One J 

9, Idintlfy out-of-^titi 310 ifforts 

that my havi iipilcatloni for Not 

your propun? ,,. Yas Ho stife 

10, Diiianiinite thi risults of Not 
out-of-Btate 310 projects? ,,.M Ml Yea No luri 

11, Providi training for staff of 310 

projecti to snabli theni to dis- Not 

seilnati project outcoiesi Yes No sure 

12. Evaluate the Isvil of uii of 310 Not 
products fdthin your State? Yii No sure 

13. Shari Inforaation ibout your 310 

project outcoMi with othir Not 

Stitis? iiiiiiiiitiiiMitiiiiiiiiii Yis No sure 



Ik, Coordinate actlvltiei with your Not 
IN State Faeilititor? Yis No Sure 



REQUEST FOR PROPOSAL CRTP'-a) 



Proggam Ideatifieg ; Teachar Training in Using Minico^utars to Teach Basic 

Skills to Low Perfoming Adults , Including Mantally 
Hatardad 

yaad/Rationala t 

Teachars of undaraducatad adults are faced with constant need to Individualiza 
instruction and provide tutorial assistance to maat tha -various fimctioning 
levels of their students « Thm potential benefit in using minico^uters in 
this endeavor is being Investigated through a IlA-funded project at the San 
Antonio State School and State Hospital* ^e results of this project must be 
disssiinated to adult educators and training be provided in the use of the 
software programs developed by the project* 

Purpose/ goal ; 

To provide orientation and training to 40 adult educators in the use of mini- 
coaputars for teaching basic skills to low parforffling adults, including man* 
tallF retarded. Also, to disseainata information and conduct training on tha 
use of software programs that were developed by the San Antonio State School 
and State Hospital. 

Objectivaa i 

Conduct a five-day workshop for 40 adult educators with focus on the following 
areas: 

a. Provide information on the various types of minicomputars and software. 
Develop a man^l for dissemination. 

b. Provide orientation in using minieomputers with imder educated and 
mentally retarded adults. 

c. Disseminata the results of research projects conducted by tha San 
Antonio State School and State Hospital. 

d* Provide training in the use of software developed by the San Antonio 
State School and State Hospital in teaching basic skills to adults. 

Specifications : 

1. Only public educational systems are eligible applicants, 

2. Project applicant must have prior e^artise in using minicomputars in 
teaching adults. 

3. Project sponsor would make all necessary annoimcements to adult educa- 
tion programs to solicit participants. 

4. Participants will be selected after consultation with the Division of 
Adult and Comimity Education Programs^ TEA. 

5. Project will reimburse participants for travel and per diem at state 
authorized rates. 
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1, Aa avmliiatiQa □£ ^hm workiiiop by participaats 

2, A fiaal report 

3, Oae huadrad copimm of a isaaMl coamaiaing iaforaatioa on various 
t^pas of alaicomputfiri and software 

Tima Frama ; 

Tte_ worksiiop will ba aoaductad ia July 1982, Projaet duj^atioa will ba 
July 1, 1982 - July 30, 1982. 

Cost : 

Cost should aot ^caad $20,000. 
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REQUEST FOR APPLICAI^r ION jurA- 



PrQ joct Identif leg : Innovative Use of Live Inxiteractiva Teiuvisitjn £u Delivery 

of Adult Education Ins tfiiAictlon 

Nead/Ra tionale ; 

Although enrollmant in adult educatioa programs has increaeed consistently the 
past 10 years I fuadiag has not kept up to mmmtx. the need for more programs* 
Therefore^ local programs either are forced t^o form large clasaey and have 
waiting lists or do not of f er a class in a Q^Emmunity where enrollment is not 
high enough to justify efl^lopeat of a teaeh^^E^. There is a need to explore 
other means of delivering iaitmction such live interactive television. 

This approach allows an instructor to reach tfic^re students and^ thus, be mora 
cost af f ectlva . 

Purpose : 

To test the use of live Intenctive televiilo^a as a means of delivering GED 
and ESL instruction to a larga geographic ar^^a. ' 

Objactivas i 7 

1, Identify existing mbdeli for use of llv^ interactive television for in* 

structlonal purposes « 
2* Develop a system for daUvij^ of GEO and ISL Instruction* 
i 3v Pilot test the system* - • 

4* Davalop videotapes and naterials to suppc^ort the system* 
5, Conduct evaluation of the system, IncludLing cost effectiveness* 

Specifications i 

1. Only public educational systems are eligirj^ble applicants. 

2, Project applicants oust have expertiie lajt use of live interactive tela* 
vision for Instruction and be familiar ^^r^th the adult education field* 

3* Applicant must have neciiiary equipmast U^o carry out project* 

4* Applicant must utilize an advisory group ^ to provide input and assistanca. 

Products I 

1. Ten copies of the modal lyitem and of all _ products developed 

2. Six copies of a final report 

Time Frame i 

Project duration will be July 1^ 1983 - June S^C^ 1986. 
Cost ; 

Cost should not exceed $42 , 000, 
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BEST COPY AVAILABL 



PROJECT IVALDATlOil STRATEGIES 



A few years ago the New Jeriay Adult Education pEOgEam contracted 
with Research for Better SchooLs^ Inc^ to produce A Validation Guide 
fo^ Adult Education Projects ^ This Guide is intended to assiit 310 
projects in the davelopinant of demonstrably effective produots or 
practices that can be adopted by other prograniB across the State* 
Included here are sections on Character istica of Validation Models ^ 
inforniation on the IVD ProcessT and practical tips on " Evaluating for 
Validation * 

The Sixth Annual CBAE Conference in Boston included a nuinber of 
presentations on project evaluation* Two articles based on presen- 
tations are provided in this section: "Evaluation of Competency- 
Based Adult Education's listing 26 criteria for avaluating 310 
projects^ and "Evaluating Innovative Adult Educat ion Pro jectil How 
to Make Evaluation Work for You" , which offers suggestions for 
overconiing barr iers to evaluation* 

The National Adult Literacy Project conducted a search for promising 
literacy practices r and "concl^ that programs with a commitment of 
systematically plan/ implement r and evaluate all components of their 
process are the ones that are most successful* They identified eight 
general characteristics of s.ucc^SBful programs that may be useful in 
developing evaluation criteria for 310 literacy projectB, Alio^ the 
book based on the NALP study^ Effective Adult Literacy Programs i 
A Practitioner's Guide y contains a ciiapter on project evaluation that 
may be helpful. 

The Division of Adult Education has published a set of "quality 
standards" for evaluation of local ABE programs * Two sections are 
included on staff development and program evaluation * These 
standards can be of use to 310 program development projects. 

Finally^ the National ABE Staff Development Consortium has 
developed a report on Principles and Techniques for Effective ABE 
Staff Development s Included here are General Principles and 
principles for Planning and Implementing Staff Development. 



-8 4- 

97 



CHAEACTERISTICS OF VM.IDATION MODEI,S 

As noted abev©, there are several different mode 1m of program 
validation that are currently beln^ used* Reedp Patrick, and Haldskom 
(1981) conducted a comprehensive survey to determine what validation 
processes were used by state education agencies. Virtually all of the 45 
scaces that reported a validation mechanism used either the IVD process, 
the JDRP process, a modification of one of these two, or a combination of 
IVD and JDEP. New Jersey falls Into the latter category, using the basic 
IVD procedures but inco^oratlng criteria from the JDRP, Although New 
Jersey has suspended its formal validation process at present. Department 
officials are currently considering reopening validation procedures and 
Instituting new validation Inltiatlvea, 

ieveral ^dispensable resource guides describe in detail the charac^ 
teriatics of validated programs, criteria for evaluation, steps for com- 
pleting the procesSf and examples of model submissions. These include the 
JDRP Ideabook (Tallmadge, 1977) and IVD's Sharing Educational Success 
(Hlnse, 1979), In addition, specific evaluation concerns are addressed in 
^o volumes published by the ir*S* Office of Iducation in the mid- 
seventies , A Procedural Guide for Vaiidatlng Achievement Gains in Eduaa-^ 
tion Projects (TallMdge and Horst, 1976) and A Practical &i±dm to 
Heasurlng Project Impact on Student Achievement (Horst, Tallmadge, and 
Wood, 1975)* Finally, Reed's (1981) report for Nil's Research 4 Develop- 
ment Exchange, The Search for Quality Control la Dissemination of Educa- 
clonal Products and Practices provides a comprehensive description of the 
various models for program validation. Although this Guide summarises 
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nueh of thm Infar^tloQ contaiAsd in Che mbova doQumeiicSf the orlglaml 
souraea should be reviewed imw mare decailed deecripci0n. 

' There are procedural differences between Che valldaclon models | there 
are also manjr similarities. Several eonsion charaaterlsclos are llaced 
below, 

m Detailed doaimentatlon of progrra baokground« developmenCs and 
operations Is needed* 

o There la usually a focus on student impm^t* 

m Impacts rauat be slgnlfloutp that Is, Important and of suf» 
flclent magnitude* 

m Evidence of Ij^act must be credible | "hard" evaluation data on 
sizable student au^les Is almost always required. 

• A sound e^erijwncal (or quasl--exp€rlmental) evaluation design 
la li^orcant In order to provide valid and reliable measures of 
post^lnterventlon conditions md credible eatlmates of condl* 
tlons without the Intervention. 

• Programs must be able to be replicated or disseminated. 

The Identification* Validation. Dissemination (IVD) Proeeas 

The IVD procesa was Initiated by several national groupa with heavy 

input from state education afenolea. Although It was initially designed 

for the valldaclon of Title III (and later Title IV^) projects, the 

developera hoped that the procedures would be applicable for validaclng 

other projecta aa well. The IVD proeeas la guided by a handbook titled 

Sharing Educational Succesai A Handb o ok for Valldaclon of Edueai:lo»Ml 

Practlcea . The hmdboofc waa written with the intention of allowing acates 

a greac deal of autono^ in the valldaclon procesa. Using IVD, states 

validate exemplary projects baaed on the following two criteria. 

® Effectlveness/aucceM ^ Project objectives Identified for 
validation are supported by convincing evidence showlni 
statlatlcally ttd educationally significant outcomes* The 
documented effectlveneaa or success of a program or pracclce is 



of parmount: Importuee for validation, A program or practlG© 
can be "prov#n to work" in numerous ways including i (1) by 
detaons tracing with eonvlnelng evidence that Che prograni will 
bring about desired ahange or improvement over exlstlnf prao- 
tl^egy (2) by demonstrating a more efficient or coat^ef feetive 
program or practice through improved management, regsurce 
utlllzatlonp etc*, or (3) by demonatratlng with convincing tvl* 
dance that a desired objecclve may be acco^llahed withouc 
detriment to the existing program. 

• Exportablllty ^ Information ±m provided to demonstrate that the 
project or practice la capable of being dif fused to other school 
dlscr lets and cm be adopted or adapted by other school dls- 
crlcts with s imila r needs and environments. For the project as 
a iAole (or for each applicable co^onent). teformatlon required 
Isnaudes evidence of educational significance, a description of 
the mijilTOttB level of adoption or replication which would produce 
similar results » md Inforsatlon about i the target populationi 
staffing and training requirements | macerlalSf equipunt, and 
facilities I replication costal and special problems. 

Sharing Educational Success describes six steps to be taken In the 

validation process* These steps can be modified by ^dividual states to 

meet their own needs, and tlme-and-'money-*saving options are auggesced. 

1. LIA compleces and submits application for validaelon to the 

state agency or office responsible for coordinating validation 
activities at the state level. 

2* Preliminary review by the state agency for validation followed 
by I 

a. approval for validation team revlewi or 

b. return to the local education agency for revision according 
to auggescionsi or 

c. disapproval for further validation. 

3. Selection of the validation ceami 

a* the taw leader to be selected out-'Of^state from the list 
of U.S. Department of Education's trained tern leaders 
within the region p 

b. two team meiDbers selected within the state from the list of 
state-trained members « 

4. Review of application by individual team members. (This may be 
done as individuals In isolation from the other team members or 
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th# team may b# aociv^ned Co review ma individual 
applieatlQn or eerve as a panel to review a group ©f 
appliemcioQii. ) 



a. the team leader makes reaei^eiidatlons to Che state ageney 
responsible for validation that the identified revisions 
are to be complettd before the on**site ceam visit tm 
condueted» 

b. Che team leader inforas the state agency responsible for 
validation chat the on-site visit is co be conducted 
aeaordlng to the existing applicatlonp 

5. Conduct of the on-site visit. The mosc frequent procedure is to 
send all team members on-site. Som states have designated an 
individual tera member to conduct the on-site visit as a cost 
saving measure, Tha Individual conducting the on«site visit 
serves the role of collecting and clarifying any ijttCQa^lete or 
missing inforaation identified by the review of the applicaclon 
by the ^ole team. 

6, The primary decision of the validation tera is either approval 
or disapproval under the ITO standards. 

If approved t the team might also make the following 
recommendations : 

a, subi^ssion to JDRF. 

b# state dissemination. 

c* a special component or produce be recognised as worchy of 
distribution. 

The %VD process requires no commitments from Che federal or scace 
govermaents. In the pasty many acates have operated their own diffusion 
necwarks and have offered dissemination funding* In addition, the IVD 
process Is often a prelimina:^ step in preparing a ^RP submission. 
Specific submission requirements for the IVD process are suimariied in the 
Appendix. 



Evaluating for Validation 

To prepare properly for validation of any project , a carefully 
planned and la^leTOnted evaluation is required. For a detailed discussion 
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of €valu3tlQn immumm In adulc edueaclont see Che CQmpanion daeument Co 
ch±a one eatitltd An Evaluation Guide for Adult Edueatlon Prolectg (Duaewieg, 
Blester and Keimeys 1983) • While Che companion doeument referenced above 
addresses evaluation planniaf, design and procedures in depth, this sea-* 
tion of Che present Guide presents a brief overview of evaluation picfalls 
and suggestions related to validation. 

Many JDRP applications are rejected because of flaws in the avalua* 
tion design* The KMC Research Corporation^ in a major effort to validate 
Project Information Packages (PIPs) for exemplar compensatory education 
programs, identified 14 common flaws or potential pitfalls in conducting 
an evaluation study (Horst, Tanmadge* and Woodp 1975). The JDRP Ideabook 
incorporates this list of evaluation hazards and describes how to avoid 
them« The flaws are listed below. 

1. Claiming much, providing evidence of little. Where evidence 
niatches the claims of t^at a project says it can do, a favorable 
decision is far more likely than where evidence falls far short 
of goals, objectives, and clali^^ 

2. Selecting measures not logically related Co the Intervention* 

3. The use of grade*»equivalent scores. Grade-equivalent scores 
provide an insensitive, and^ In some Instances » a systematically 
distorted assessment of cognitive growth. As such, the JDRP 
does not regard them as credible Indicators of achievement or 
growth. 

4. The use of a single set of test scores for both selecttog and 
pretesting participants, 

5. The use of comparisons with inappropriate test dates for 
obtaining information. In norm-referenced evaluations « tests 
should be administered at nearly the mmmm time as the cesc 
publisher tested the norm group. 

6. The use of ijiapproprlate levels of tests. 

7. Hissing data, 

8. The use of noncomparable treatment and control groups. 
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9, The use of inappr©pr±a£e staclaclcal adJuBtmentg with non- 
equivalent concrol grQUpa. Making betw#en-group comparisons 
using either "raw" gain scores or "residual" gain seores shoyld 
bm assiduously avoided* 

10. Conscnieting a maCehed control group after the treatment group 
has been selected* 

11 • The aareless aolleocion of data. 

12. The use of different Instruments for pretesting and posttesting, 

13. The use of inappropriate fomulas to generate no^treatmentt 
expeGCatlons. Many projects use an unrealistic theoretical 
model or formula to calculate "expected" posttest scores from IQ 
or other preeeat scores^ If studencs do better than the 
calculated exp#ctation, the project is considered a success. 

14. Mistaken attribution of causality. The plausibility of 
alteraatlve explanations should be carefully examined before 
evaluation results are attributed to project impact , as 
evaluation hazards are often the cause of apparent gains or 
losses. 



It is important to consider these potential pitfalls in the projecc 
planning stages. If project administrators and staff do not understand 
the issues in dealing with such pitfalls, the JDRF recomends hiring an 
evaluation consultant. However * hiring an evaluation specialist after the 
fact cannot eliminate such flaws, 

RBS- experience with the JDRP and IVD processes hts suggested a few 

other recommendations for preparing a validation application * as follows. 

1. Panel members will not spend a lot of time la laboring to 

understamd the essential elements of your submission. Issential 
points need to be stated in a clear, concise way. 

2* Regarding the above poiatg consider the use of subheadings that 
directly reflect the panel's criteria for assessing evidence of 
effectiveness (JDRP criteria are Interpretability* credibility, 
evidence of Impact, statistical reliability, educational sig^ 
nificmce, internal validity* and external validity) , Speci- 
fically noting these under explicit subheadings would help 
assure the reader that you have attended to all concerns. 

3. In addition to being a technical doeiment, the submission is 

also a marketing docuTCnt. You need to "sell" the reader on Che 
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idea that your project la important:, effective, and worth being 
disseminated am eKemplary. 



4. Make a case for your projeec'a un:^quenesa right up front. 
Unique solutions to comon pfobleioos stand a better chance for 
acceptance « 

5. Clearly indicate your claiis of t^fectiveness. The "evidence" 
section ehows ^y you aft oiking each claim. Evidence must be 
credible. 

6. Sample aise and corapa risen grDUps ^re often problems with vali-^ 
dation of adult basic education ps^ograms. A strategy S||cce8S- 
fully employed by the F.I*S,T. projeet in New Brunswick was to 
use a replication desigfi whtfe the evaluation study was con-- 
ducted twice* SJ^larly positive evaluation results for 
different samples at twa points iim time proved to be convincing 
evidence for JDHP despitt imall sample sizes and the lack of a 
comparison group, 

7. Don't make claims for outeomis wh&ye there is no evidence* 

8. Consider the docusientation of aid& effects as you plan your 
evaluation study. 

9. Remember that panel membtri, for tie most parts tend to have an 
"experimental psychology" ptripect ^ve when it comes to 
evaluation* As such« you'll need use the Jargon of 
experimental design. 

10. Talk to someone familiar with the J'DRP process before going to 
Washington for your f Jxial panel re^^iew. The experience can 
often be an intimidating and f rusticating one for those who don't 
Imow what to expect, 

11. Don't be discouraged if the initial application is not accepted. 
Valuable feedback and eKperiince w:dLll have been gained and 
reapplications are often auceissfuJL* 



A ^RP-valida ted project operated thraugh Middlesex Collegei evaluation 
assistance was received from Kutgifi Unlversityp and from RBS. 
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EVALUATION OF COMPETENCY- B AS EU ^iJX'f iC^TlQf 1 PROGRAMS 

V 

Judith Alampreae, Offlea of EdyestiSfi^l t#^t>,d Improvement 

Jmmas ParkMp Office of V^paatiQ^l #^Jidal^ Jcs^ucation 
lJ,S*Dept, ef Edue^^t^^ 

Tha prlnelple msahaniam Is tha Dapt. iQti^itlQ^ fo^ ^ evaluating exemplaTry 
pragrmraa ii the Joint Diasminatloa R©via^ t^^e PameL eKamineg 

evidgaca from edueatlDm pregraina that alal^ %rt#^tlViMl^ tin attaining their 
ioals and datenainea whether they hav^e mat |0aU* 0^^mm q£ the queattona 

that tha Panel aaks arei 

-Has a poaitive ehangs oeeur^d aa the JJ^^©gram2 

•Can the ehanga be attributed te th^ p^^H^wth^r ^ttlian to other 
causes such as normal maturationf ^€guX#% %^ii^iCt^%^t 1 programs , or 
other factors? 

the change educational Ijr itislfiomtf^^ 

-Can the program be used in oth^r l^eatl^^^ ^^^^mrable impact? 

To date, four Adult Education prograaa h#V# Wia ftpj^^^ioved hy the JDRp* 

*\ 

Once a program has received appffo^al, i% X0 ili|ibl^ fr-to apply for a grant 
from the National Diffusion Ne^oite (NDN). %pipr^irt4*^a funding so that 

Che program can be disa^inated throughout ^^0ttjr ^appropriate settings* 

The JDRF process may not be faedlble fa^^^fpwj«*^^# However^ adult 
educators beliave there is a need for Co^on o£^^^^luating ipeaial 

projectSi Compatible evaluation methods cqUl^, tf^ta^ adoption of good 

practices and products , reduce dupllcatlons^Q^^pJ^^t^^^ and increase our 
undirstandiag of what works in Adult EducatiOti^ liuQitiQ^ Dept« staff are 
working with states to identify the raflge of th^0 projects could use 

Co answer some basic evaluation quae tlon^. IHiitiQi^^^ were davelopad 

_aftar considarable dialog with national, staft# i.\^lQeal A^E practitioners and 
reiaarchers. In addition, a raviaw of e^aluAtto^ '^itt^^^tonts was conducted 
and data were incorporated* Project dlraetoi^^fc % A pt^j^^ct monitors , and 
evaluation consultants may find thaae quaatiQ^^ ^rfetermining the : 

quality and potential Impact of thatr prejact^*^ <liiy atf^ te^urrently being 
Ets tad with a variety of projeotst asaeaStoant ^r^lHUii Qi^^crlcula developmanti 
delivery lystiOTs I recMltment I counaallngi aA^ g^ff Cfai^tttng programs Caee 
attached list of questions). 



SUGGESTED CRITERIA FOR EVALUA-nNG SECTION 31Q 
AND OTHER DEVELOPMENTAL PR03ECTS 



U fri what way(s) doas the project address 
the intent of the Adult EducatiQn Act? 

2* bi what way dees the prQiact address 
state and local needs? 



3^ How does the pro|e« identify intended 
partieipants? 

4« In what ways does the project use 
rMources effertlvely? 



5^ How do st^ and learner share 
responsibility for goal setting? 



6m How do staff and learners share 
responsibility for instruction? 

7- How do staff and le^ners share 
responsibUity for assessment? 



S. To what extent is the admlmstrative 
struc£itf e adequate for acWevament 
of the objectiv«? 

% How are projects/practlces/produrts 
written and organized for adoption/ 
adaption at other sites? 

10. To what extent are the liaison 
activities and collaborations 
neceaary for the success of the 
project clearly desCTibed? 

11. To what extent is the record* 
keeping system adequate for 
implementing the practice/product? 

12. How can parts of practices/produrts 
be i^ad independently? 

13. To what extent is the physical environ- 
ment appropriate for the implemantation 
of the practlce/product/project? 



14. To what extent is funding adequate 
for the achievement of objectives? 

15. To what extent are the dianges 
caused by the i^e of practices/ 
products worth the money? 

16* How are the costs for adoption 
identified? 

17. frs what ways ran produra/practices 

be incorporated into on^going programming 
withotrt coatinued specif support? 

11. To what extent are the project's 
goals/obje^ves clearly defined 
and Mplic^tly stated? 

19. How is thm process of practices/product 
implementation identified? 

20* To what extent is the evaluation 
design/evidMce appropriate for 
determining the project's success 
in rea^ng its goals and objectives? 

21* How are the prQ|e«'s outcomes 
identified and documented? 



22. To what extent ve the project's 
successes due to staff characteristics 
that are repUcabie? 

23. To what extent are the project's 
success due to program characteristics 
that are repllcable? 



In what ways are dianges In participants* 
behavior caused by practices/products? 



25. How are project costs documented? 

26. To what extent is there a reasonable 
relationship of costs to changes? 
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EVALUATING INNOVATIVE ADULT EDUCTION PEOJECTHi 



HOW TO MAKE EVAI^ATION WORK FOR YOU 

by 

Dif* James Daegam 
MatMpQlitan Stmte Uaiveiralty 
St* Paul, HN 

Grata Floats 
LitaMcy 85 
St, Paul, MN 

Fears and mliconcaptlona about avaluation " perceiving avaluation as a punish- 
niant or ai an expose^ of faulti « often blook e£f eetive evaluation in eempetancy- 
ba^ed adult aducatlQn progfasia* Other barriers to helpful evaluation, aited by Dr. 
Jamei Deegan, include absence of criteria to measure suooeis, lack of plariming; and 
staff inexperience in research. AliO| sots program managers are unwilling to 
allocata money for evaluation purposes | they comsldar evaluation an eKpenslve "add-« 
on'% or as taking away from program essentials, 

Dr«, Deegan shared ideas about the development^ nurtutance and evaluation of 
educational innovatloms* Rather than advising programs to develop a single model 
or evaluation paradl^, Deegan suggested action*oriented, self-study principles 
that can be applied in any evaluation^ "These Ideas are not really new, revolution- 
ary,' or startling I they simply are not being used by ^ny adult education program 
planners." 

The self-study approach to evaluation provides a foundation for planning efforts, 
enhances program openness, and helps staff to assess progress in meeting goals and 
criteria* Basic characteristics of an effective self-study Include the following 
components: motivation for the evaluation cornea from t^lthin the organisation, 
rather from an outside forcei an Informed attrapt Is make to clarify goals and 
assess achlev^ent of the goala for purposes of l^rovement| there is representative 
participation by members of the various segmenta of the education consnunityi and 
a readable report, potentially useful to several audiences is produced. 

Sources of information and data can be derived from program interaction activities 
such as anecdotal records provided by teachers, teacher meetings, end-of-activity 
surveys, advisory groups, student Interviews, attrition studies and informal consul- 
tants* Data can also be gathered from program outcome activities ^ including student 
performance on criterion referenced tests, follow-up studies of graduates, teacher 
Interviews, student ^eKit Interviews and student self-assessment, 

Greta PtoetE described two innovative adult education projects and illustrated 
ways in which the self study approach was used In one model and how It is being 
incorporated into the development of a new project. The ADVANCE Competency- based 
Adult Diploma Program was developed as a 310 Project In the Mounds View School 
District's adult education deparWent, model features a competency«based 

curriculum in required course areas and the assessment of e^eriential learning In 
elective course areas, Ouidelines developed by the Council for the Advancement oc 
Experiential Learning (^EL) were adapted for high school level leaming. Self 
study techniques used included teacher observation, student perceptions and surveys, 
Advlsqry Board recotsaenda tlons , and a portfolio review process. 



"Dr. Deefan and I are n^w imvolvad io the davelopmanfe ©f -Llteifaey 85* , a 
project designed to improve llteraey and basic education sgrvicei for adults in 
a larie three county area of metropolitaa St, Fauly " Greta explained* The 
Literacy S5 evaluation proeeas goes hand in hand with project developmeiit and 
the self study approach la b€ing utilized throughout the project's activities. 
Several St, Paul foundations are providing funds for the five year project which 
will coordinate educational 9 corpora ta and hwan resources ^ promote a broad 
public relations effortp conduct researchp and assist literacy programa in 
initiating self study evaluations. 

In ADVANCl and Literacy 8Jp as with other Innovative programs ^ a major goal 
of the self study evaluation process is the development of a better system of 
on»gaing« institutional research, self analysis and self iic^rovement. Competency- 
baaed adult education efforts using this flexible approach can put to rest 
inhibiting "fears and misconceptions" about evaluation. 
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Adult funational illiteracy is a ^jor ''hidden** problem in Uia 
United StateSp Yet, the eeonomla and social costs of illiteracy 
are obvious: forty percent of adults witii yearly incomes under 
$5r000 are functionally illiterate* Yearly costs in welfare 
programs and unemployment compensation are estimated at $6 billion. 
AlsOf functional Illiterates constitute about 60% of thm prison 
population mnd 85% of the youngsters who appear in juvenile court 
are disabled readers. 

Functional Illiteracy is a critical problem confronting a large 
portion of our citizenry. Adult education programs, as they 
currmtly exist, offer only a part of the solution « ^d, despite 
the publicity that has surrounded tiiis issue, few efforts have 
focused on nationwide solutions to tiie Literacy problems faced by 
many Americans^ However, the President's wd Secretary's 
Initiative on Adult liiteracy has brought renewed national 
attention to the need to expand and revitalize literacy training 
and development. 

The National Adult Literacy Project was designed to help meet Uiis 
call byi 

# promoting cooperation and collaboration between the public 
and private sectors to offer Literacy inmteuction to the many 
adults who need and desire iti and 

• improving service through the spread of the best information 
available on literacy practice and instruction. 

To accomplish til is mission, one critical task was thm conduct of a 
nationwide Promising Practices search. The search was designed to 
be comprehensive and broad-based^ nominations from a variety of 
public and private sector settings were solicited nationwide. 
However, it was not intended to be a validation study of existing 
programs or to yield an e^austlve directory^ ^e result of our 
NALP work. Effective Adult Literacy Programs^ A Practitioner's 
Gu ide , w ill be published by the Cambridge Book Company this fall . 
This Guide is designed to provide literacy practitioners with the 
most curr^t, state of the art information on effective literacy 
practices. 

The Gu ide is based on our examination of literacy programs 
offering a variety of services to participants — such as basic 
skills instruction, anglish as a Second Language (ESL) 
instruction, mn& job training. In total, 250 programs responded 
to a mail surveyi 38 programs drawn from Uiat nunber were the 
subjects of an intensive field investigation. Represented are 
progr^ns operated by State/Local Education Agencies, Qnployment 
and Training ag«icies and organizations. Community Based 
organizati^ws and Corrections, Military, and Postsecondary 
organisations. 

Reflection on our fieldwork and survey results has provided us 
wiUi a unique perspective on the state of adult literacy education 
in the united States. 



Ours begai as a predictable journey r ware to describe program 
instruction mnd operation ^ and we painted that picture in rich 
detail. The picture reveals boto Uie dedication and commitment of 
literacy educators and the severe obstacles they encounter as teey 
work to make their programs a success • 

We began by focusing our attention on the parts or components of 
programs y with an eye to identifying promising literacy practices 
rather than model ^ogr^^. Yetr the central finding of the MALP 
Promising Practices Searcdi was Uiat program with a commitment to 
integrate and systematically plan, implement, and evaluate all 
aspects and components of their educational process those that 
create a coherait system o£ adult literacy instruction — appear 
to be the ones that are most successful. 

These programs have the following general char acter: is tics i 

• They are clear about tiieir overall goal and philosophy of 
instruction. 

• They develop measurable goals for every component of their 
program (i^e., reCTultment, orientation, counseling) so that 
they can lopnitor their success in meeting these goals* 

• They assist: potential Learners in determining if the ^ogram 
is well-suited to the learners* goals and expectations* 

• They are explicit ^out intended learning outcomes for 
participants and their standards for judging success in 
achieving these outcomes, and this information is shared with 
progrw participants* 

m They carefully diagnose learner's educational needs and 

strengths and develop an individually tailored learning plan 
for each participant* 

• They tie learning objectives to Instructional methods and 
materials and assessment s^ategies* 

0 They provide frequent feedback to learners on toeir progress 
in mastering their learning objectives and they carefully 
document that progress* 

• They ft^uently evaluate Uielr program's effectiveness in 
meeting its goals in each of Uie component areas, and they 
use this evaluation data to Improve their literacy program^ 

Iftiile not the only examples, two educational systems which exhibit 
these characteristics arei 

• the Comprehensive Competencies Program (CCP) developed by 
Remediation and Training Institute with funding from the Ford 
Foundation I amd 

• the California Assessment System for l^dult Students (CAShS) 
developed by San Diego Community College District and the 
ChBhS Consortium with support from the California Deparbnent 
of Bducatlon. 113 



Our journay ahowad Uiat much is being done by dedicated 
prof ess lonals f ifoluntaars and coimnunity members. We were 
enaouragad by the many promising prmcticaa we were able to 
deser lbe« 

However, we recognize that many millions of Mieriaans continue to 
suffer the eonsequences and costs of Illiteracy. Given their 
needr we must continue to call attention and resources to the 
delivery of quality and systematic services to tiiose In need of 
those services. This commlteent is necessary to ensure our 
continued economic growth and development , the vitality of our 
democracy, and Uie Individual dlgnl^ of all of our citizens. In 
our vlw, there can be few 9^^' ter investaaents in Ikmerica's future* 

For further Information , contacti 

Renee LercAe, Director 
Literacy Education and ^ployment Group 
The NET9fORKr Inc. 
290 South Haln Street 
Andover , BiassacAusetts 0 18 10 
SL7-470-10 80 
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STAFF DEVELOFHEH? 
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Standard At The lEiff divelopounC eoiponint of thi adult 

eduEatlon progrii his eliarly idintlflabii goali 
and objectlvai for liproylng instructor 
ConpitinciiSt 

Elements A. 1 Goals and objectivii are cliirly dif ined 
for iiprovlng instructional sklllg. 

A. 2 Ooaig and obJictlviB an stated rilatlng to 

thi liprovipent of ioitructor knovlgdgi of 
. prograi content ■ 

Standard B. A forial niids ssiessient li eonductid aiong gtaff 
to ascirtaln their training neidai 

Eliffignts Bii A forial niids asiisi^nt li pirlodiailljr 
conducted aiong itaf f ind faculty to 
aacirtain triining needi and prioritieii 

B. 2 Frogrii itrin|tha and veaknaiiei are 

iddriiiid in dsveloping InsirHci triining 
progiaisi 

Bi3 Studint racoiiendatioM an soniidirad vhin 

prograui 



Oui 

IS 

h 



t; 



13 
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Standard C. Staff divilopient actlyitlea an planned Ihroughout 
thg year to Met divetii niidi o! lacultjfi • 
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OIISIRVATSON 
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MATiAUt. RiVliWfD 
AND/OR 


Elements Cml Frovislons art mai% tot conducting an 
for newly ippolntad staff • 












C*2 Trends and diVilopiBanti In adult education 
programs are regularly disiesinated and 
Qiscussea wiLn scaxi* 












€•3 Outside resource pirsonnal are utilised as 
guest speakers on spicialised topics* 












Ce4 local staff ara provided opportunltits to 
share their expertisoi resiarch (indingSs 
etc#i at designated BeetingSi 












ard D« Staff developsant sessions art eviluated to 

detersiiie their effectiveness in such areas as 
infomation disseiiinationt prograi relevancy^ 
and quality of prasantations* 












lleBents D*l An assassaant of the overall quality of 

staff devalopaant instruction Is regularly 
conducted* 








r - 




D.2 Participants have the opportunity to rate 
the quality of the training pertaiiiing to 
InforQatlon dlssiainatloni neetlng 
identified needs | and quality of 
* presentations* 












Di3 Results of current and previous avaluations 
are utiliiad in designing future training 
progress* 
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STAIF TOLOPHIKT 
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Standard !• Staff dsvelopiiint ictlvltlii tiavi immi thi 
adult iducatlon prograi through iiprovlng 
Eiacher iffsetlveniss In instructing adults. 

lliiaeatg 1,1 Evidenct ii ivailibli to Indlcats 

Infltrycton havi liprgvad thglr skilli 
used in taichlni proirii participanti. 

hi Ttichirs have diionatratgd to studints 
and adiinistratora an Increiaid knoRledge 
of prograi contantt 

Ei3 Teachgri havg dgionatratid iBproved 
proficlancy In acqulrln| and utiUilni 
proirai latirlaii. 

Ii4 FacuUif vho havi partlclpatgd In atiff 
divilopiint actlvlcigi hivg dgionatritad 
saaiurii to liprovg proirai if f ietivinisi , 
Including reduced drop*outS| ineriaied 
student coipliterii oliUlning lori 
Inforiation on itudintii Increiied 
rafgrrals, etc* 



E.5 



Studenti participitlng in thi idult biiic 
aducation prograi hivi Indieatad thai ihi 
quillty of initruetion hii iiprovid, 
claiiei an lore ralivintp or that thiir 
needa ara biini addreiaed nre iffictiyil; 
than priviouily« 



li6 Staff divelopBint proirai iccoBaodatei 
teacher profeailonal developMnti 
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EVALUATION 



I 

g 



Standard A, The proirii providii for an iviiuaEion ceaponant 
conslitlng of litdbiek ftoa etudints regirding 
thiir pirciptlon of propai iffictlvsnisi. 

IliBiints Ail StudanEi hava ri|ulit opportunitlii to 
provldi feedback tiachira and 
counailors reflicting their perceptlona 
of how gffeetivi thi prograi haa bign for 
thii 

Ai2 Inforaatlon ie eoUicUd froi |raduatei ' 
and prdgrai Igaveri relating to thg 
adequacy of Initructlon and their ability 
to pureue further gdueatisn and tralningi 

Standard B. Fgedback la obtained froi groupa, organiiatlgne, 
and rglatid prograis that hava an intireit In thi 
coBtinuatlon,of the prograii 

lieiienti 1*1 Inforution froi an iiiiting advlaor; 
eoDnlttii or partleipatory planning 
eouittei la obtiined and utiliiadi 

Si 2 Fggdback li obtained froi slhir organiia" 
tioni and tilatid progran concerninf 
eoordliiatlon and rifirral Igrvisiii 

Standard C. Iipaet Inforiitlon la rigulirlr sbUinid froi iludinl 
eoipUteri and liavara diaeribing Ihi riiulei of 
the prograii 



Ou 

m 



iieaenta dl Infonitlon pertaining to work ralalid 
outeoiea la collecttdi 
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AND/OR 
OBSiRVATION 



sriiiiuntiuii 



Gt2 Inforiatlon pirtaining to riduced 
depandincy upon valfari Is colleetidi 

Ci3 Infomacion concarnlng atudints intirlng 
adult licondaryi or coUige prograis ia 




Ci4 Inforiatlon concirning studsnta entirlng 
trainini prograii such aa vocational 
iducationand Jobi Training Fartnirahlp Act 
(JTFA) la available. 



inco 
and 



G*5 Inforiatlon deacrlblni Incriaaed 
Isvila of itudenta dealing with 
faiily life coping altuatlonai 



0.6 Inforiatlon deacrlblng the eitent to trhicb 
itudent objectivea are set ii availablg. 

Ct7 Inforiatlon pertalDlng to Increaied liveli 
of self confidence In coping with locietil 
deaanda la avallBble. 

C.8 Inforiation li avillibli to diierlbi 
Incraiaad atudint iffictlveneii in coping 
with lituationi pertaUing to conauiir 
econoilci, occupational knovlidgii hiiithi 
coiaunity reaoureiii govarniint and livi 



MATiMALRIVliWEO 
ANQ^OR 

OBSiliyATION 
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€.9 InfoEistlon is available to diicribi 
Incriaaad student pFoflclancy In reidlng, 
writing, speakinii liitinlng, coiputatlon, 
and problei aolvlni* 

Instructors are Involved in leaiuring progfai 
iipleiintatloni 

Dil Instructors laki rigular assessienti of 
students- progreiii 

Dt2 Initryctori vliv isseisient of atudint 
progress as an integral part of initruetion/ 
learning/ application and as necesBarjp to 
both student and eourie/initruction 
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GENERAL PRINCIPLES 
OF STAFF DEVELOPMENT 



1* For aff active staff davalopinant to oeaur/ a human elimata of 
opannasSy aeGeptanoe, and trust must be established, 

2m The importance of a positive Qlimate for professional davalopmant 
includas a comfortabia physical anvironment, and the building of a 
"spirit" among staff. 

3, Staff davalopmant plannars are aware of Havighurst's "teaehable 
moment^'/ and provida activities which will be available at those 
times for Individual staff. 



4. An assential prerequisite for a succassful inservica adueation 
program is that staff davalopmant participants ara traated as 
prof assionals and mature adults who want to continue to axpand 
their skills and competance. 

5. The experience base of adults is takan into account whan planning 
inservice programs* Activities are plannad which relate to each 
individual's conceptual framework and accomodate and build upon 
the past eKperlenca of all participants. 

6. Staff devalopmant builds on teacher strengths. The most competant 
and anthusiastic taachers are ancouragad to be involved. 

7. Whan a participant chooses to becoma involved in an activity^ 
there is a far greatar likalihood that the aicparianca will be 
maaningf ul « 

8. The implementation of maaningf ul and quality professional develops 
ment activities involves considering the situation^ skills and 
ejcperianca of current staff. 

9. Participants are involved on a number of differant lavels 
including diagnosing, implementing and avaluating their own 
learning experiences. 

10* Staff davelopment policies that provide for specific ABE staff 
developroant includa raimbursement of aicpanses, release time for 
staff development and other targeted policias. 

11. The school principal or program director is involved in inservica 
programs. 

12. District level support Is visible. 

13* Iff active staff development raquiras budgetary and moral support 
from administrators and cotmnunity membars who care enough to 
involve themselves in the process. 
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14. Staff davalQpment activitiea that are linked to a pEofessional 

developinent plan or a general effort of the school or organisation 
are more effeetive than a series of one-shot approaQhes on a 
variety of topiQS. 

13, An administrative structure that allows for program and budget 
flexibility to plan^ develop and fund speeifio ABE staff 
development activities contributes to a successful staff 
development program, 

16. Staff development programs are closely related to State or local 
priorities and program needs, 

17. An awareness and articulation of the beliefs and values about the 
purposes of staff development will provide order and purpose to 
ABE staff development activities. 

18. Staff development is an "on^going" process that encourages growth 
of continuing staff and encourages new staff to become an 
integral part of the system and program development, 

19. Staff development focuses on goals which are both meaningful 
and attainable^ given the constrains which are present in the 
teaching/learning environment. 

20* When the goal of the staff development program or activity 

involves organizational change, staff development leaders are 
familiar vath the basic practices of organisation development. 

21. New practices are likely to be abandoned unless teachers have 
evidence of positive effects. 

22. Evaluation is an integral component of staff development. 

23. Ivaluation provides continuous feedback on staff development 
effectiveness, employs a variety of techniques, and influences 
future planning and implementation of staff development 
activities . 

24. Trainees learning a new teaching strategy need 15 to 20 
demonstrations over the course of the training sequence and a 
do^en or more opportunities to practice the skill. 
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PRINCIPLES FOR PL&NNiNG 
STAFF DIVELOPHENT 



An early step in staff development is an assessment of teacher 
needs in relation to those of their students. 

Planners consider the individual's level of experience in their 
present ass ignment . 

Effective professional development activities are based on a 
continuous assessment of participants' needs - as needs change^ 
the activities are adjusted accordingly. 

Perceived training needs of teachers and needs of the program are 
assessed. 

Assessments are made of participants' learning styles and habits. 

Teachers are involved in the planning of staff development 
activities and share in the responsibilities. 

Activities that view each participant as a resource are more 
responsive to participants' needs. 

All segments of those involved in the program are involved in the 
planning including teachers^ administrators^ counselors^ para- 
professionals, and volunteers. 

Collaborative Inservice program planning and implementation is 
increasingly important as States develop mora comprehensive 
approaches to teacher training and staff development. 

Programs led by teachers, school supervisors, ar*^ college staff 
are more effective than those lad by outside consultants, school 
district staff, or State department of education staff, 

iKpectations are stated at the outset and througout the process. 
Otherwise, participants are likely to assume that activities are 
designed for purposes other than intended. 

New ideas are related to student achievement and teachers have 
the opportunity to document student achievement in relation to 
the new ideas ^ 

Participants go to a staff development session knowing the basic 
goals of the activity. Awareness and readiness create an environ- 
ment where the exchange of ideas can take place, 

Inservice programs are planned to accomodate both short and long 
range staff needs. 
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15. Profassional developmerit activifelis ^^hich take place at the end 
of a work day have less ohanc% oi be^ ng auccesaf ul than those 
offered whan participanta are ft^^h* Further ^ they are less 
likely to be sucQesaful when tP^y ir» scheduled at times of the 
year when aeasonal aotivitieg^ ^onfeE- enees ^ etCp occur, 

16. Teachers are permitted to participate in staff developmant 
activities on "prime time" ag p^it off their professional 
assignment • 

17. Staff development sessions ar^ btld i^n comfortable surroundings , 
preferably away from school gic^sthat permit interruptions or 
entice staff back to their romJine t^ska . 
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PRINCIPLES FOR STAFf DgVStOf ^S-iENT IMPLEMENTATION 



Participants in profasaional QiviLop^roent activities know^ a) what 
will hm aKpected of them duri^^ths aeti vitiea i b) what they will 
be able to do when the eKperl%jice overi c) how they will be 

evaluated , 

The activity provides poaiti v% ino^*^'^ ^i vea to recipients for 
their participation^ both during th^ activity and during its 
implementation* 

Adult learning is focused upori prii#^3it life activities rather 
than upon preparation for fut^ji tola-^s # which means that 
individuals are seeking irrunediiti tp^^l ieat ion of learning to 
their present problems or cirQi^mit^fl^^es . 

A staff development prograin tl^Jt pt^^^ides different educational 
experiences for participants %i dlCfei^rent stages of development 
is more likely to achieve itg ebjaotfcdvea than one in which all 
participants engage in common jotivitr^iea * 

The activity provides bu££ ic fii tifimm for recipients to learn^ 
practice ^ master^ and apply tl^# soht&ent imparted* 

Staff development takes spaced Uin%/ i.e* teachers need intervals 
in which to plan and try out r^jn apjptt^ caches and return to 
evaluate their succeasea and piobl^rfia^ • intensive "one-shot" 
schedules of an hour/ day/ ox are likely to effect little 

change* 

Time for experimentation is pttfvidQ^ while teachers adapt new 
practices to meet the needs qfi thit^ students. Personal, in- 
classroom assistance from mdmi^iit^^^Kor s and fellow teachers is 
essential during this process^ 

The activity provides systeiniG and gE, inical support during the 
activity and during the perlcfl of itf^slementation in the 
classroom. 

During training sessions/ oppo^tunltH,es are provided for small- 
group disaussions of the appll^itl^f^ of new practices and sharing 
of ideas and concerns about ^fi^ioti^^^ instruction. 

Activities permit variation in the W^ays that learners parti- 
cipate/ and in ways that thay ijii wp^^t they learn* 

Alternative structures for dmXimiia^s ABE staff development are 
provided* 

When activities require per^^n^l sOci^fcact , informality and an 
exchange of ideas/ 7 to 10 per^ioip^r^^ts are optimal. 



13. ti - eipants ' concerna are listened to, and appropriate adjust-* 
ment MXB made, 

14. Vtrie^Taa prograni patterns emphasizing teacher responsibility^ such 
as 1 if -instEUCtion^ pear study groups , college courses, and 
oiie**t*^— one consultation are used, 

15i The i^mstructional approaq^hes which teachers use are determined 
by th^eir experience of success or failure in the classroom* 
To ijny^rove educational practices, staff development provide 
Gonor^^te and specific methods, support as they are implemented, 
and o^ppor tun i ties for teachers to observe learning outcomes, 

16. Tsach^^rs are allowed to express and resolve concerns about the 
%ttmc^^B of changes on them personally* 

17. Tcain:^ng shows how new practices may be implemented without major 
dls^uB^tlon. 

18. Tcaifl^ing content has been verified by research to improve student 
aQhia^p*^©ment * 

19i Ttach^srs are willing to try new ideas when they are working in 
tsam^ or have the support of a group of colleagues* 

20. dlvifl^g teachers the opportunity to periodically meet and share 
iim^M with colleagues is valuable in providing support and 

fid 1 1 t a t i ng change . 

21. Tiacji^^rs are provided materials to read and study on their own, 
Thaa# materials include both theory and practice, 

22. TsaQji^SES are given the opportunity to observe other teachers at 
work ^^rying out the new ideas and to talk with them about what 
they ^^bserve, 

23. Insaj^^ice education is translated into classroom use to create an 
imm^dsmate impact on teaching and learning. 

24. TiaoH^^rs are provided feedback in regard to student learning 
outcoi^aes* 

25* TiacH^^rs trained as staff developers are highly effective in 
workicrng with other staff members to effect change* 

26i Ntw p^^Qcedures are presented clearly and eKplicitly by a person 
pirC0^ived as credible by the group in training* 
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27 • pcofesiional dfeV%l_opment activities ar^ ^raora suceessSiil -giiifi tht 
ptasantac is BhXm tQ appCoieh the subj%^^ ^ from the tl jelpants ' 
viaw. 

28* The instcuctQt is able to inQdel what it i is proposed ttia^ 
recipients do in t..^heir woil^ lattinga* 

29* When paftieipanta leave t^iining aetivit:: les there is a S^lafl gt 
set of initructlofUmal materials ready imnadiete u%# * 
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